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ABSTRACT 

1 .  A  rigorous  proof  of  the  relation  between  the  solutions  of  wave  and  telegraph  equations  in  3D  via  arandom  time  induced  by  a  Poisson 
process  has  been  provided  using  techniques  of  stochastic  calculus.  Application  of  this  relation  to  wave  propagation  in  dispersive  media 
(Lorentz  and  Drude  media)  is  discussed. 

2.  Sparse  grid  collocation  methods  that  are  used  for  uncertainty  quantification  have  been  applied  to  electromagnetic  propagation  problems. 
Two  applications  are  considered— the  first  application  involves  waves  propagating  in  dielectric  media  with  uncertain  permittivities  and 
permeabilities,  in  which  several  cases  with  increasing  random  space  dimensionality  are  exemplified.  The  objective  in  the  second 
application  is  to  compute  expected  signal  strength  above  flat  Earth  surface  at  ranges  far  from  transmitter  location,  where  randomness  is 
present  due  to  uncertain  refractive  index  of  the  atmosphere.  The  uncertainty  is  extracted  from  published  measurements,  and  constitutes  long¬ 
term  variation.  Two  different  sparse  grid  algorithms  are  demonstrated  and  the  deterministic  evaluators  are  accessed  as  a  black  box  by  the 
sparse  grid  algorithms.  Strengths  of  the  two  algorithms  are  differentiated  depending  on  the  characteristics  of  the  randomness. 
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In  this  project  we  were  exploring  the  use  of  particle-based  techniques  (viz.  those  based  on  random  walks  or  Poisson  processes) 
for  solving  wave  propagation  problems.  By  far,  the  biggest  motivation  for  considering  these  particle-based  methods  is  that  they 
are  very  attractive  for  implementing  on  parallel  machines  without  requiring  any  mutual  communication  between  nodes.  The 
model  equations  for  time-harmonic  case  included  the  Helmholtz  equation  and  the  parabolic  equation.  The  latter  is  an 
approximation  of  the  Helmholtz  equation  and  assumes  the  wave  propagation  angles  to  deviate  slightly  (less  than  or  equal  to  15 
degrees  in  practice)  from  a  nominal  direction.  In  terrestrial  radiowave  propagation  problems,  this  nominal  direction  is  often  taken 
to  be  the  horizontal  direction.  The  model  equations  for  time-instantaneous  case  included  the  higher  dimensional  wave  equation 
and  the  telegrapher  equation.  The  telegrapher’s  equation  is  relevant  because  a  variation  of  it  is  encountered  in  the  treatment  of 
pulse  propagation  in  a  dispersive  medium. 

In  2D,  interference  phenomena  that  is  hallmark  of  time-harmonic  wave  propagation  can  still  be  modeled  by  random  walk  of 
particles  by  assigning  parity  or  spin  to  particles  in  addition  to  translational  motion  [8].  We  first  considered  TM  propagation  (field 
vanishing  on  the  boundaries)  in  a  parallel  plate  waveguide  by  the  4-state  random  walk  (FRW)  subject  to  Dirichlet  boundary 
conditions  [9].  In  order  to  accommodate  semi-infinite  boundaries  with  the  parabolic  equation,  we  first  worked  out  an  efficient 
local  transparent  boundary  condition  for  low  grazing  angle  waves  for  use  with  Crank-Nicolson  finite-difference  implementations 
in  [10].  Previous  implementations  of  the  parabolic  equation  relied  on  non-local  transparent  boundary  condition,  which  can 
computationally  very  expensive.  Our  solution  should  significantly  reduce  the  implementation  of  the  transparent  boundary 
conditions. 

Even  though  the  4-state  particle-based  technique  could  reproduce  results  obtained  by  traditional  approaches,  the  method  was 
limited  to  rather  small  physical  dimension  along  the  direction  of  propagation  because  the  number  of  possible  trajectories 
increased  exponentially  with  range  (there  will  be  two  possibilities  at  the  first  range  step,  four  possibilities  at  the  second  range 
step,  and  so  on). 

A  second  paradigm  we  pursued  was  the  treatment  of  telegraph  equation  by  particle  -based  methods  [1].  Most  previous  works 
related  to  this  problem  concentrated  on  building  random  walk  models  tied  to  the  Brownian  motion.  However,  it  had  previously 
been  shown  by  Kac  (demonstrated  for  1-D  with  zero  initial  velocity  conditions  and  conjectured  for  higher  dimensions)  in  the 
early  70s  that  the  solution  of  a  lossy  wave  equation  (which  is  a  modified  telegrapher’s  equation)  can  be  obtained  from  that  of  a 
corresponding  lossless  wave  equation  by  simply  changing  the  time  variable  in  the  latter  by  a  randomized  time  variable  that 
depends  on  a  Poisson  process  and  then  performing  an  averaging  operation  with  respect  to  the  underlying  Poisson  process. 

The  statistics  of  the  Poisson  process  are  governed  by  the  loss  present  in  the  medium.  This  resulted  in  a  very  interesting 
stochastic  representation  for  the  solution  of  telegrapher  equation,  which  could  be  conveniently  implemented  on  a  parallel  type  of 
computing  machine.  In  [4]  we  presented  1)  a  mathematical  proof  of  Kac’s  conjecture  in  higher  space  dimensions  using 
concepts  from  stochastic  calculus;  no  such  formal  proof  existed  in  the  literature  prior  to  this  work,  2)  given  the  important  role 
played  by  the  random  time  in  such  stochastic  representations,  we  presented  a  new  expression  for  the  first  order  statistics  of  the 
random  time,  and  3)  demonstrated  how  the  stochastic  representation  can  be  utilized  to  arrive  at  some  useful  schemes  for 
computing  multidimensional  fields  in  dispersive  media.  In  particular,  the  Lorentz  and  Drude  media  were  considered  in  [4], 
Evaluation  of  some  integrals  arising  in  wave  propagation  by  such  Poisson  process  driven  random  time  was  presented  in  [2]. 

A  third  major  focus  of  this  project  was  developing  techniques  for  quantifying  random  uncertainties  in  wave  propagation 
problems.  Sparse  grid  collocation  methods  were  used  in  [3],  [6]  for  uncertainty  quantification  in  electromagnetic  propagation 
problems.  Two  applications  were  considered.  The  first  application  involved  waves  propagating  in  dielectric  media  with  uncertain 
permittivities  and 

Permeabilities.  Several  cases  with  increasing  random  space  dimensionality  were  exemplified.  The  objective  in  the  second 
application  was  to  compute  expected  signal  strength  above  flat  Earth  surface  at  ranges  far  from  transmitter  location,  where 
randomness  was  present  due  to  uncertain  refractive  index  of  the  atmosphere.  The  uncertainty  was  extracted  from  published 
measurements  and  constituted  for  long-term  variations.  Two  different  sparse  grid  algorithms  were  demonstrated  in  [6],  and  the 
deterministic  evaluators  were  accessed  as  a  black  box  by  the  sparse  grid  algorithms. 

Other  relevant  problems  that  were  addressed  in  the  current  project  were  (1)  Simple  formulas  were  derived  for  the 
electromagnetic  degrees  of  freedom  in  random  scattering  environments  for  a  network  of  nodes  communicating  with  each  other 
[7].  Both  near  fields  and  far-fields  were  considered  in  the  formulation.  (2)  A  new  Volterra  integral  equation  of  the  second  kind 
with  square  integrable  kernel  was  derived  for  paraxial  propagation  of  radiowaves  over  a  gently  varying,  perfectly  conducting 
rough  surface  [5],  The  formulation  is  valid  for  both  deterministic  and  random  rough  surfaces.  The  integral  equation  was  solved 
exactly  in  terms  of  an  infinite  series  and  the  necessary  and  sufficient  conditions  for  the  solution  to  exist  and  converge  were 
established.  Super  exponential  convergence  of  the  Neumann  series  for  arbitrary  surface  slope  was  established  through 
asymptotic  analysis.  Expressions  were  derived  for  the  determination  of  the  number  of  terms  needed  to  achieve  a  given 
accuracy,  the  latter  depending  on  the  parameters  of  the  rough  surface,  the  frequency  of  operation  and  the  maximum  range. 
Numerical  results  with  truncated  series  were  compared  with  that  obtained  by  solving  the  integral  equation  numerically  for  a 
sinusoidal  surface,  Gaussian  hill,  and  a  random  rough  surface  with  Pierson-Moskowitz  roughness  spectrum.  The  first  term  on 
the  series  solution  by  itself  yields  the  well  known  Ament  roughness  reduction  factor  for  determining 
the  mean  field  over  a  random  rough  surface.  This  term  will  only  incorporate  the  variance  and  mean  of  the  rough  surface. 
Correlation  function  of  the  rough 


surface  will  enter  through  the  second  term  of  the  Neumann  series  and  will  open  the  door  for  the  availability  of  analytical 
formulas  for  the  mean  complex  field  and  the  mean  power.  Availability  of  such  analytical  expressions  for  the  mean  field  will  be 
useful  in  propagation  modeling  for  radar  detection  and  wireless  communications  and  in  the  electronic  and  thermal  modeling  of 
nano-devices. 
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Motivation 

•  Particle  based  Random  Walks  (RW) 

•  Parallel  Realizations 

•  No  mesh  generation 

•  Promise:  Complex  and  intricate  geometries 

•  Telegrapher's  Equation  (TE) 

o  Lossy  Wave  Equation  in  Time  Domain 
o  Loss  <  Poisson  Process 
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Goldstein  (1951)-Kac  (1974)  Approach:  Collisions  in  1-D 


•  a:  expected  arrival 
frequency 

J  1,  with  probability  1  —  aAt 
—1,  with  probability  aAt 


•  Binary  RV 


Sn— vAt(l+ei  +  Cl  62  +  •••  +  £l£2--£n-l) 


t  =  lim  nAt 
At — 


X 


Poisson  Process 

x  vt 

with  rate  ‘a’ 

UMassAmherst 


Rare  events  in  continuous-time:  Poisson  RP 


Prob  {N  (t)  =  k}  = 


•  Continuous  analogue  of  Sn 


*  Random  time 


t  :=  f  (  — 1  )N^dr 


o 


t 


<t 


— V 


15 


UMassAmherst 


Relation  to  Wave  Equation 


d2F  

1  d2F 

•  Initial 

II 

-+-i 

a 

ii 

•1-B  WE 

OX2 

v2  dt 2 

Conditions 

g{x)  :=  ^ 

•  Solution: 

d’Alembert’s 

Formula 


Fwe(%,  t) 


x+vt 

[(/>(x  —  vt)  +  (j)(x  4-  vt)\  +  <^7  /  g( CMC 

x—vt 


•1-0  TE 


a2F 

dx 2 


1  <92F 
v2  dt 2 


,  2a  aF 
'  v2  dt 


Fte(x >  0 


Randomize  the 
time  variable 


t  <->  t  =  f(-l)N^d 
0 


Arithmetic  average  of 
randomized  functions 
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Results  in  1-D:  <KX)  AO  §(x)  0 


frF 

dx 2 


v 


1  d2F  ,2 adF 

-T  v2 


2  dt 2 


>2  dt 
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1 
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0 
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x/vT 


1.5 


■Fte  (Exact) 

.Fte  (Stochastic) 


A 

1  - . 


a=10  (1/s) 
T=1  (s) 
v=l  (m/s) 
N,  =103 


FTE{x,t)  =  + 
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Non-zero  initial  rate:  ^(x)  — ^  g(x)^0 


/  X~\ —vt  \ 

FTE{x,t)  =  ^(  f 

'x  —  vt  ' 


•  Several  attempts  for  higher 
dimensional  problems 


7 


18 


UMass  Amherst 


A  2-D  Model:  Orsingher,  1986 


<92F 

dt2 


2a 


d  F 

dt 


^V2F 


2D-TE 


4-state  walk 


Vertical  or 
horizontal  move 
during  each  At 


Scattering  events: 
Poisson  (a) 


No  back- 
scattering 
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Sample  Trajectory 


State  Change 

|X|  y  reversal 
X  x  reversal 


x 
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IVP  in  2D:  M  =  s(p) 0 


FTB(Exact)  Fte(RW) 


(£f  i  o adF_ 
at2  -t-  £<x  dt 


^v2f 


a=20  (1/s)  V— 1  (m/s) 
L=vT=0.6  (m)  Nr  =2.108 
At  =5.10~3  (s) _ 
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IVP  in  2D:  M  =  s(p) 0 


11 
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Problem  2:  Distributed  initial  source 


<f>(p)  :=  F(p,  t=0)  = 

g(p)  ■= 


dF(P,t) 
dt 


t=o 


(fro,P  =  p 
0,  elsewhere 

=  0 


(s) 


L=  p  +vT=1.5  (m)  a — 10  (1/s) 
]XL  =109 
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Problem  3:  Distributed  initial  rate 
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Conclusions 

•  Demonstrated 

o  ID  walks  with  initial  distribution  and  rate 
o  Implemented  a  2D  RW  (non-isotropic) 

•  Need  to  develop  isotropic  RW  models. 

•  Extension  to  real  problems. 
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Abstract — The  relationship  between  the  solution  of  a  lossy  wave 
equation  and  that  of  a  lossless  wave  equation  established  via  the 
Poisson  process  is  exploited  to  derive  some  new  integral  identities. 

I.  Introduction 

It  has  previously  been  shown  by  Kac  [1]  that  the  solution 
of  a  lossy  wave  equation  in  multiple  space  dimensions  can  be 
obtained  from  that  of  a  corresponding  lossless  wave  equation 
by  simply  changing  the  time  variable  t  in  the  latter  by  a 
randomized  time  variable  t  that  depends  on  a  Poisson  process. 
In  ID  a  particle  travels  in  space  with  a  constant  velocity  v 
whose  direction  will  be  altered  by  collisions  present  in  the 
medium  and  occurring  at  random  times  through  a  Poisson 
process.  The  statistics  of  the  Poisson  process  are,  in  turn, 
governed  by  the  loss  present  in  the  medium.  In  this  paper, 
we  use  this  relationship  to  demonstrate  how  to  derive  new 
expressions  for  the  various  moments  of  the  randomized  time 
as  well  as  establish  some  new  integral  identities. 


traveling  in  the  conducting  medium.  The  average  number 
of  collisions  N(t)  in  an  interval  t  is  equal  to  N(t)  = 
=  k}  =  t/2r.  A  random  time  t  related 
to  the  Poisson  process  is  first  defined  as 


t 


o 


The  integrand  u(t)  =  (— l)7V(t)  in  (4)  takes  on  values  ±1 
depending  on  whether  N(t)  is  even  or  odd  and  is  known  as 
the  telegraph  signal  in  the  literature  [3].  In  the  special  case  of 
a  lossless  medium,  N(t)  =  0  and  t  =  t.  However,  in  general, 
—t<t<t.  Using  this  random  time,  one  may  express  the 
solution  ip(r;t)  to  the  lossy  wave  equation  (1)  in  terms  of  the 
solution  ip(r ;t)  to  the  lossless  wave  equation  as  [1] 


II.  Theory 


For  a  wave  propagating  in  a  linear,  homogeneous  conduct¬ 
ing  medium  characterized  by  the  usual  electrical  parameters 
(e,//,cr),  the  Cartesian  components  of  the  fields  satisfy  the 
lossy  wave  equation  [2] 


22  d2ip  ldijj 

1  v*  =  W  +  rm' 


(i) 


where  t  is  the  time- variable,  v  =  1/ ^JJIe  is  the  speed  of  light 
in  a  lossless  medium  with  parameters  (e,//),  and  r  =  e/a  is 
the  relaxation  time  of  charges  in  the  conducting  medium.  In  a 
lossless  medium  r  — >  oo  and  (1)  reduces  to  the  dispersionless 
wave  equation.  Equation  (1)  is  supplemented  by  the  initial 
conditions 


ip(r;t  =  0)  =  /( r), 


dip 

dt 


(r  ;t  =  0)  =  g(  r), 


(2) 


where  r  =  (x,y,z)  and  possibly  by  boundary  conditions 
resulting  from  physical  boundaries.  Kac  [1]  constructed  a 
stochastic  model  for  (1)  by  associating  the  relaxation  time 
with  a  Poisson  random  process  N(t)  that  takes  on  only  integer 
values  k  =  0, 1, . . .  and  governed  by  the  law 

t  (  —  )k 

ProbfMt)  =k}  =  e  2^  (3) 

k\ 

The  quantity  N(t)  may  be  thought  of  as  the  number  of 
random  collisions  experienced  in  a  time  interval  t  by  a  particle 


VK1-;  t)  =  (<£>(r;  t)),  (5) 

where  (•)  denotes  the  expectation  operator  with  respect  to 
the  randomness  of  the  Poisson  process  N(a).  In  ID  with 
r  =  xx,  the  solution  of  the  lossy  wave  equation  in  an 
unbounded  medium  with  the  initial  conditions  given  in  (2) 
can  be  expressed  using  (5)  and  the  d’Alembert’s  formula  for 
lossless  wave  equation  [2],  [4]: 


i ’(•»"/)  = 


f(x  +  vt)  +  f(x  —  vt) 


x-\-vt 


h  I  »«>■* 


x—vt 


^  (6) 


Kac  [1]  only  considered  the  case  with  zero  velocity  (i.e.,  with 
g{x)  =  0),  but  (6)  generalizes  his  result.  We  will  first  use 
the  ID  case  to  generate  some  useful  results  for  the  various 
moments  of  the  random  time  t.  Equation  (6)  can  be  put  in  a 
more  suitable  form  if  the  initial  data  are  expressed  in  terms 
of  their  Fourier  transforms.  The  function  f(x)  and  its  Fourier 
transform  F(kx )  are  related  by  the  usual  transform  relationship 


oo 

/(*)  =  2-  J  F{kx)eikxX  dkx.  (7) 

—  OO 
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Using  a  similar  definition  for  g{pc)  and  substituting  into  (6) 
we  arrive  at 


OO 

2-  J  F(kx)elkxX  (cos (kxvt))  dkx  + 


+ 


OO 

1  f  •  j  (sinfeuf)) 

r  /  G(kx)e  kx  - — — —  dkx.  (8) 

j7T  J  KxV 


This  alternate  form  is  advantageous  because  the  averaging 
operation  has  been  transferred  to  known  functions.  One  needs 
to  know  the  nth  moment  yn(f)  =  ( tn )  of  the  random  time 
t  in  order  to  perform  these  averages.  The  Laplace  transform 
Yn(s)  of  the  nth  moment  is  given  in  [1]: 


T(s)  =  J  1n(t)e  st 
0 


dt  = 


[s(s+l/r)](n+1)/2  5 


.  s[s(s+l/r)]n/2  ’ 


n  odd, 

(9) 

n  even, 


which  can  be  inverted  easily  to  find  7 n(t).  The  results  for 
n  =  1  and  n  =  2  are 


71(f)  =2 re  t/2r  sinh  (t/2r) ,  72(f)  =  2rt 


The  explicit  solution  for  the  lossy  wave  equation  in  ID  is 
given  in  [4] 


-t/2r  \  f(x  +  vt )  +  f(x  ~  vt ) 

l 


X  +  Vt 


x—vt 


'/o  (^T^2^2  ~~  rd^  (n) 


where  /q(-)  is  the  modified  Bessel  function  of  order  zero. 
Equations  (6),  (8)  and  (11)  may  be  equated  to  each  other  to 
yield  a  number  of  interesting  results.  For  instance  using  x  =  0 
and  f{pc)  =  0,  we  get 


(12) 


Note  as  already  indicated  that  the  quantity  vt  could  be  positive 
or  negative  even  if  t  is  positive. 


Choice-1:  g(£)  =  e~xGvt 

Evaluating  the  left  and  right  sides  of  (12)  by  using  [5, 
formula  6.616-5,  p.  690]  we  get 


(  sinh  (  y 


Ae-*/2T 


:  sinh 


=  e 


-t/2r  T 


dX 


it/ 2r)2 

cosh  A2  +  (f/2r)2^ 


(yvrw^F) 

(13) 


This  identity  could  be  used  to  find  yn(f)  for  any  n.  For  ex¬ 
ample,  differentiating  both  sides  of  (13)  with  respect  to  A  and 


evaluating  at  A  =  0  yields  71(f)  =  2r  exp(— f/2r)  sinh(f/2r) 
which  agrees  with  that  given  in  (10). 

Choice-2:  g(£)  =  elb ^ 

In  this  case  one  gets  the  useful  result 

(sin  (hvt) >  =  b-^-2—  j  eib£/o  yyl  dC  (14) 

—  Vt  ^  ' 


Using  (5)  and  the  explicit  representation  given  in  [2],  the 
solution  for  the  lossy  wave  equation  in  2D  with  zero  initial 
condition  is 


i>(x,y;t) 


1  ff  j  H(vt  —  R) 
2irvJJ  \  y/v ip  _  B2 


g(r0)dr0,(l5) 


-t/2r  f  f 

So 


COsh  (  2^:  Vv2t2  —  R 2) 

\Jv2t2  —  R 2 


dr0, 


(16) 


where  iT(-)  is  the  Heavy  side  step  function,  1*0  =  (^o?2/o)» 
i?2  =  (x  —  xo)2  +  (y  —  yo)2  and  g( r)  is  non-zero  over 
the  spatial  domain  defined  by  So.  The  presence  of  the  step 
function  ensures  that  the  domain  of  dependence  is  R  <  vt. 
One  may  use  the  identities  [5,  6.671-1],  [4,  §5.9,  (75)],  and 
(14)  to  yield 


xp(x,y,t) 


e-t/2r 


2ttv 


JJ  H(vt  -  R)g( r0)  J  kJ0(kR) 

So  0 


(17) 


Comparing  (17)  and  (16)  we  obtain  a  new  identity  (the  zeroth 
order  Hankel  transform)  which  is  not  available  in  [5]: 


cosh  (^77^) 
y/  v2t2  —  R 2 

(18) 
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Abstract — Efficient  calculation  of  expected  (mean)  propagation 
factor  for  wave  propagation  above  a  random  long-range  terrain  is 
achieved.  An  adaptive  sparse  grid  collocation  algorithm  (ASGC) 
is  applied  for  interpolating  each  component  function  from  an 
adaptive  high  dimensional  model  representations  (HDMR)  de¬ 
composition.  The  decomposition  reveals  significant  elimination  of 
redundant  sampling.  The  obtained  results  are  compared  with  the 
reference  solution  obtained  with  a  large  set  of  samples  simulated 
with  Monte-Carlo  method. 

I.  Introduction 

There  are  several  sampling  based  interpolation  tools  for 
uncertainty  quantification  (UQ)  in  propagation  environments 
of  our  interest,  where  the  environment  would  have  random 
sources,  boundaries  or  domain  parameters.  Monte-Carlo  (MC) 
simulation  is  the  most  common  method  to  perform  UQ,  whereas 
recent  developments  have  emerged  with  the  effort  of  improving 
the  low  MC  convergence  rate  of  1/ \/Q,  where  Q  is  the  number 
of  samples  out  of  an  N— dimensional  parameter  space.  Here  we 
assume  that  randomness  is  present  in  N  independent  random 
variables  (RVs).  The  stochastic  collocation  (SC)  method  [1] 
samples  from  a  predetermined  sparse  grid  irrespective  of  the 
target  function  that  is  interpolated,  whereas  variations  of  an 
adaptive  sparse  grid  collocation  (ASGC)  were  developed  for 
discarding  redundant  samples  out  of  the  SC  sparse  grid  [2]. 
Although  ASGC  can  resolve  non- smooth  behavior  of  the  target 
function,  its  performance  worsens  as  N  gets  high.  The  high 
dimensional  model  representations  (HDMR)  [3]  allow  us  to 
exactly  decompose  the  high  dimensional  target  function  into 
lower  dimensional  components  and  interpolate  each  component 
with  ASGC.  For  the  decompose-and- solve  strategy  we  follow  an 
approach  similar  to  [4].  The  propagation  problem  is  introduced 
in  the  next  section,  whereas  a  sample  result  is  depicted  and 
compared  to  that  with  MC  sampling  in  Section  III. 

II.  Low-Grazing  Angle  Propagation  Over  a  Random 
Rough  Surface 

The  low-grazing  angle  propagation  over  a  1-D  random  sur¬ 
face  in  the  2-D  free-space  has  been  governed  by  the  parabolic 
equation  (PE)  approximation  to  the  2-D  Helmholtz  equation, 
whereas  an  efficient  numerical  solver  is  in  the  form  of  a  Volterra 
integral  equation  of  2nd  kind  [5].  The  model  geometry  is 
depicted  in  Figure  1,  where  a  source  function  s(z)  is  excited 
from  x  —  0  plane,  and  the  expected  (mean)  propagation  factor 
(PF)  is  sought  at  a  long-range  plane  x  —  xQ.  PF  is  the  ratio 


of  the  total  field  to  the  incident  field,  PF  —  \^tot{z) / Vmc(^)|, 
where  'ipinc(z)  is  the  field  observed  in  Figure  1  without  the 
presence  of  surface  g(x).  We  here  assume  the  surface  to  be 
perfectly  conducting  (PEC).  We  will  not  go  into  details  of  the 
numerical  solver,  but  mention  how  the  random  surface  g(x )  is 
formed.  Since  it  is  our  interest  to  utilize  emerging  tools  for  UQ 
for  increasing  N  rather  than  start  with  a  problem  of  very  high 
N,  we  do  not  generate  a  rough  surface  from  a  large  number 
of  RVs,  but  instead  control  N  by  forming  g(x)  from  a  series 
of  non-overlapping  Gaussian  hills  along  x,  where  bth  hill  is 
randomized  by  3  uniform  RVs:  gb  =  U[/i™tn,  g™ax]  controls 
the  mean  position  of  the  hill,  crb  —  U[cr™m,  cr™ax]  controls  the 
width  of  the  hill  and  Ab  =  U[A™m,A™a:E]  controls  the  peak 
height  of  the  hill.  The  overall  surface  is  determined  by  g(x)  — 
gb(x)  =  Abexp[-(x  -  iib)2/2a^]  ,^-(b  -  1)  <  x  <  ^b, 
6  =  1,  2, 77.  Therefore,  the  dimensionality  for  above  problem 
is  N  —  377,  where  the  applied  UQ  methods  and  concerns  about 
applicability  of  this  scattering  problem  are  detailed  in  [6]. 

With  each  realization  of  the  3 B  RVs  a  surface  profile  g(x) 
is  initiated  and  the  resultant  deterministic  scattering  problem 
is  solved  by  the  integral  equation  solver.  Since  it  is  the  de¬ 
terministic  solver  that  exploits  most  of  the  used  memory  in 
long-range  propagation  rather  than  the  memory  for  storage, 
indexing  and  search  of  the  samples  in  SC,  ASGC  and  HDMR 
routines,  the  computational  cost  of  each  method  in  our  case 
is  highly  proportional  to  the  number  of  samples  each  method 
takes.  It  is  therefore  our  goal  to  come  up  with  the  optimal 
interpolation  method  that  will  converge  to  the  desired  accuracy 
in  the  expected  field  with  as  small  sample  size  Q  as  possible. 

III.  Sample  Result  and  Discussion 

In  the  sample  problem  we  compute  the  expected  PF  at  an 
observation  range  of  xQ  =  420m.  The  range  is  partitioned  into 
seven  regions  each  with  a  Gauss  hill,  thus  the  dimensionality 
is  N  =  3 B  =  21.  The  excitation  from  x  —  0  is  a  distributed 
source:  s(z)  =  As  exp  [— ik^z  sin  a  —  (z  —  zt)2  /cr^,  where  ko 
is  the  free-space  wavenumber.  The  excitation  is  centered  at  an 
elevation  of  zt  —  3m,  has  a  width  parameter  as  =  0.3m,  and  is 
steered  with  respect  to  range  axis  ( x )  by  a  —  5°.  The  frequency 
of  operation  is  1  GHz. 

Figure  2  depicts  the  error  in  PF  calculated  with  different 
methods,  whereas  the  reference  solution  was  obtained  from  a 
set  of  106  MC  samples.  The  normalized  mean-squared  error 
(NMSE)  error  is  defined  with  respect  to  the  reference  solution 
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Fig.  1.  The  computation  domain  for  the  scattering  problem,  denoted  with  the 
dashed  lines. 


as: 

T  | PF(x0,z)~  PFref{x0,  z)\2  dz 

NMSE  =  — - — - ,  (1) 

/  \PFref(x0,z)\2  dz 
0 

where  PF(x0,  z)  is  the  mean  PF  calculated  obtained  with  each 
method  and  is  a  finite  elevation  that  truncates  the  domain, 

(^max  Zt)/cTt  >  1- 

Since  the  above  error  definition  is  in  squared  sense,  one 
expects  the  MC  error  convergence  be  0(Q~1).  Due  to  its 
dimensionality-dependent  error  convergence  nature,  the  conver¬ 
gence  error  with  SC  method  in  Figure  2  is  Q-0'523.  Although 
the  ASGC  in  general  represents  a  much  better  convergence  than 
SC  up  to  moderate  dimensionality,  the  non- smooth  nature  of  PF 
in  the  domain  of  RVs  in  this  problem  prevents  ASGC  to  con¬ 
vergence  better  than  MC.  In  the  case  of  HDMR  decomposition 
on  the  other  hand,  the  error  convergence  has  a  rate  Q-1'18.  For 
instance,  with  roughly  1,000  samples,  the  HDMR  allows  more 
than  one  order  of  magnitude  less  error  than  the  ASGC  solution. 
The  convergence  rates  were  obtained  by  linear  regression. 

For  the  details  of  SC  and  ASGC  methods  we  refer  the  reader 
to  [1]  and  [2].  We  will  discuss  how  the  dimensionality  reduc¬ 
tion  performed  by  HDMR  affects  the  overall  target  function 
behavior.  A  target  function  to  interpolate  in  the  TV— dimensional 
random  space  is  exactly  decomposed  as  [3]: 


N 


+ 

II 

5>0S)+  E 

i=  1  l<i\<i2<N 

+ 

•••  +  ^  ]  fi\...ip  O'ii  5  •••5  Yip) 

l<i\<...<ip<N 

+ 

-  +  M...n(Yi,...,Yn),  (2) 

where  y  =  (Yi,Y2, 

..,Yn)  is  the  set  of  N  RVs.  In  the  cases  of 

SC  and  ASGC,  the  target  function  f(y)  is  interpolated  directly, 
whereas  in  HDMR  (2)  represents  /  in  terms  of  components  /j, 
i  =  (hi  ^2,  p  is  the  “order”  of  the  corresponding  com¬ 

ponent.  Most  components  in  (2)  are  eliminated  depending  on 
their  contribution  to  the  statistics  of  the  TV— dimensional  target 
function  /  [4].  For  the  21— dimensional  problem  the  HDMR 


Fig.  2.  Normalized  mean-squared  error  convergence  with  respect  to  Q.  The 
convergence  rate  of  each  method  is  displayed  in  parentheses. 


routine  terminated  after  order  three,  therefore  in  Figure  2  the 
curve  that  corresponds  to  HDMR  decomposition  (green-dashed) 
depicts  four  markers  including  order  0,  where  each  marker 
corresponds  to  NMSE  obtained  with  corresponding  maximum 
order.  The  markers  in  the  other  curves  have  different  meanings, 
but  all  correspond  to  the  error  at  respective  sample  sizes. 

IV.  Conclusion 

We  have  applied  the  HDMR  for  dimensionality  reduction  in  a 
propagation  over  random  terrain  problem,  where  each  reduced¬ 
dimensional  component  is  interpolated  with  ASGC.  The  NMSE 
in  expected  PF  revealed  best  convergence  when  HDMR  is 
used.  Higher  order  cases  where  the  terrain  is  a  rough  surface 
generated  by  a  large  set  of  RVs,  e.g.  with  Gaussian  statistics, 
will  be  considered  in  the  future. 
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On  Random  Time  and  on  the  Relation  Between 
Wave  and  Telegraph  Equations 

Ramakrishna  Janas wamy,  Fellow,  IEEE 


Abstract — Kac’s  conjecture  relating  the  solution  of  wave 
and  telegraph  equations  in  higher  dimensions  through  a 
Poisson-process-driven  random  time  is  established  through 
the  concepts  of  stochastic  calculus.  New  expression  is  derived  for 
the  probability  density  function  of  the  random  time.  We  demon¬ 
strate  how  the  relationship  between  the  solution  of  a  lossy  wave- 
and  that  of  a  lossless  wave  equation  can  be  exploited  to  derive  some 
statistical  identities.  Relevance  of  the  results  presented  to  the  study 
of  pulse  propagation  in  a  dispersive  medium  characterized  by  a 
Lorentz  or  Drude  model  is  discussed  and  new  evolution  equations 
for  2-D  Maxwell’s  equations  are  presented  for  the  Drude  medium. 
It  is  shown  that  the  computational  time  required  for  updating  the 
electric  field  using  the  stochastic  technique  is  expected  to  go  up  as 

o{Vt). 

Index  Terms — Dispersive  media,  finite-difference  time  domain 
(FDTD),  Poisson  processes,  random  time,  stochastic  differential 
equations,  telegrapher’s  equation. 


I.  INTRODUCTION 

THERE  has  been  an  interest  lately  in  developing  prob¬ 
abilistic,  stochastic,  or  Monte  Carlo  methods  for  field 
computation  [1].  The  basic  idea  is  to  formulate  a  stochastic 
process,  producing  an  appropriate  random  variable,  whose  ex¬ 
pected  value  is  the  solution  of  a  certain  deterministic  problem. 
Among  the  computational  advantages  of  the  stochastic  method 
that  various  researchers  have  advanced  are  1)  the  method  is 
local  in  that  the  field  can  be  calculated  at  a  desired  point  only 
without  having  to  obtain  the  global  solution  by  solving  a  linear 
system  of  equations,  2)  the  method  needs  no  meshing,  3)  the 
degree  of  accuracy  can  be  controlled  by  varying  the  sample  size 
(or  number  of  realizations),  4)  the  method  in  inherently  parallel 
because  the  intermediate  results  generated  by  each  random 
realization  are  independent  of  each  other.  The  resurgence  of 
interest  in  the  method  is  likely  triggered  by  the  last  feature. 
Garcia  and  Sadiku  [2]  applied  the  random  walk  method  with 
a  variable  step-size  to  solve  Poisson’s  equation.  Le  Coz  et 
al.  [3]  determined  the  frequency-dependent  capacitance  and 
inductance  of  high-speed  computer  interconnects  using  the 
random  walk  method  and  quasi-static  approximations.  Subse¬ 
quent  researchers  have  developed  random  walk  method  for  the 
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Helmholtz  and  wave  equations  [4],  [5],  and  [6].  Budaev  and 
Bogy  [7]  applied  the  stochastic  differential  equation  technique 
to  solve  the  complete  transport  equation  pertaining  to  the 
amplitude  part  of  the  solution  of  the  scalar  Helmholtz  equation 
in  an  inhomogeneous  medium.  The  same  technique  was  used 
in  [8]  and  [9]  to  address  the  problem  of  wedge  diffraction 
with  impedance  boundary  conditions.  The  basic  differential 
equations  that  form  the  subject  matter  of  the  present  paper  are 
the  3-D  version  of  the  telegrapher’s  equation  and  the  wave 
equation  and  certain  stochastic  quantities  that  relate  the  two. 

The  connection  between  partial  differential  equations  (PDE) 
and  random  dispersion  of  particles  in  space-time  has  a  long  his¬ 
tory;  see  [10]— [1 3]  for  some  of  the  initial  work.  Majority  of 
the  works  that  followed  these  papers  concentrated  on  random 
walks  tied  to  the  Brownian  motion.  The  research  has  been  doc¬ 
umented  in  a  number  of  books  and  research  monographs  such 
as  [  1 4]-[  1 7] .  It  has  previously  been  shown  by  Kac  [18]  (demon¬ 
strated  for  1-D  with  zero  initial  velocity  conditions  and  conjec¬ 
tured  for  higher  dimensions)  that  the  solution  of  a  lossy  wave 
equation  (which  is  a  modified  telegrapher’s  equation)  can  be  ob¬ 
tained  from  that  of  a  corresponding  lossless  wave  equation  by 
simply  changing  the  time  variable  t  in  the  latter  by  a  random¬ 
ized  time  variable  ((t)  that  depends  on  a  Poisson  process  and 
then  performing  an  averaging  operation  with  respect  to  the  un¬ 
derlying  Poisson  process.  The  statistics  of  the  Poisson  process 
are  governed  by  the  loss  present  in  the  medium.  This  resulted  in 
a  very  interesting  stochastic  representation  for  the  solution  of  te¬ 
legrapher  equation,  which  could  be  conveniently  implemented 
on  a  parallel  type  of  computing  machine.  The  link  between  wave 
and  telegrapher’s  equations  via  random  time  is  very  interesting 
and  implies  that  macroscopic  loss  mechanisms  can  be  thought 
of  as  arising  from  randomized  time  and  an  averaging  process. 
Following  Kac’s  work,  a  number  of  researchers  advanced  the 
idea  further  and  attempted  to  build  random  walk  models  for  the 
telegrapher’s  equation  in  higher  dimensions.  Some  of  this  latter 
work  is  nicely  summarized  in  [19]  as  well  as  in  the  recent  paper 
[20]. 

Unlike  some  of  the  recent  work,  the  present  paper  is  not  con¬ 
cerned  with  building  random  walk  models  for  the  telegrapher’s 
equations.  Rather,  the  contributions  of  the  present  paper  are  1) 
presenting  a  mathematical  proof  of  Kac’s  conjecture  in  higher 
space  dimensions  (Section  II-C)  using  concepts  from  stochastic 
calculus  [21];  no  such  formal  proof  currently  exists  in  the  lit¬ 
erature  to  the  best  knowledge  of  the  present  author,  2)  given 
the  important  role  played  by  the  random  time  in  such  stochastic 
representations,  presenting  a  new  expression  for  the  first  order 
statistics  of  the  random  time  (II-D),  and  3)  demonstrating  how 
the  stochastic  representation  can  be  utilized  to  arrive  at  some 
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useful  schemes  for  computing  multidimensional  fields  in  dis¬ 
persive  media  (Subsection  II-E).  In  particular,  the  Lorentz  and 
Drude  media  are  considered  in  Subsection  II-E.  Hence,  apart 
from  being  pedagogical  in  nature,  the  paper  contains  new  re¬ 
sults  that  are  of  interest  to  researchers  working  in  the  area  of 
wave  propagation.  If  the  idea  of  random  time  can  be  extended  to 
more  complicated  dispersive  media  than  the  ones  considered  in 
the  paper,  the  concept  could  provide  an  alternate  means  to  com¬ 
puting  the  time-instantaneous  field  in  those  media  where  ana¬ 
lytical  expressions  are  not  available.  For  the  benefit  of  readers 
unfamiliar  with  the  techniques  of  stochastic  processes  and  the 
associated  calculus,  we  first  present  some  basic  properties  of 
Poisson  processes  and  preliminaries  of  stochastic  calculus  in 
Section  II-A.  The  relevance  of  the  stochastic  model  presented 
here  to  the  study  of  pulse  propagation  in  a  causal  dispersive 
media,  such  as  the  Lorentz-  or  Drude-model  medium  is  dis¬ 
cussed  in  Section  II-E. 


II.  Theory 

A.  Poisson  Process  and  Preliminaries  of  Stochastic  Calculus 

A  Poisson  random  process  N(t)  is  constructed  from  a  se¬ 
quence  of  independent  and  identically  distributed  exponential 
random  variables  t\  ,  T2 , . . .  known  as  inter-arrival  times ,  each 
with  mean  r  [22].  Starting  from  a  value  of  zero  at  time  t  —  0, 
the  process  N(t)  jumps  by  unit  value  at  the  arrival  times  given 
by 


Fig.  1.  Poisson  processes  and  the  functions  generated  from  it.  (a)  Sample 
Poisson  process,  (b)  the  Telegraph  signal,  (c)  increment  of  the  Telegraph  signal, 
and  (d)  Random  time. 


tn  =  TA  n  =  1,2,....  (1) 

i=  1 

The  function  N(t)  is  assumed  to  be  right- continuous  in  that 
N(t)  =  limsit  N(s)  (s  l  t  means  s  —>  t  from  s  >  t;  likewise 
s  T  t  means  s  —>  t  from  s  <  t)  and  can  be  expressed  as 

oo 

N{t)  =  Y,  e(*  -  tn)  (2) 

n=  1 

where  0  (t)  is  the  unit-step  function  equal  to  0  for  t  <  0  and 
equal  to  1  for  t  >  0.  Fig.  1(a)  shows  one  sample  path  of  a 
Poisson  process.  Because  the  expected  time  between  jumps  is  r, 
the  jumps  arrive  at  an  average  rate  of  A  :=  1/r  and  the  process 
itself  has  the  distribution 


Using  Property  P2  it  is  easy  to  establish  that  the  expected  incre¬ 
ment,  which  is  equal  to  the  average  number  of  jumps  between 
times  s  and  t  for  t  >  s  is 

E [JV(*)  -  N(s)}  =  A (t  -  s)  (4) 

where  E  denotes  expectation  operator  and  it  is  assumed  that  the 
right-hand  side  of  (4)  will  be  rounded  to  the  nearest  integer. 
Hence,  the  expected  number  of  jumps  between  5  and  t  is  only 
dependent  on  the  elapsed  time  (t  —  s),  but  not  on  the  epoch  s. 
A  stochastic  integral  equation  of  the  form 

t  t 

X(t)=X( 0)  +  J  f[X(cr);  a]  da  +  j  g[X(a);a ]  dN(a) 

0  0 

(5) 


P{N(t)  =  k}  =  *  =  0,1,...  (3) 

where  P  denotes  probability.  This  last  result  can  be  derived  from 
the  fact  that  tn  given  in  (1)  has  a  gamma  distribution  [21]. 

In  addition,  N(t)  satisfies  the  following  properties: 

PI)  Independence  of  Increments — for  all  0  <  t0  <  t±  < 
£2  <  *  *  •  <  tmn  >  1,  the  random  variables  N(ti)  — 
N(t0),  N(t2 )  -  N(ti), N(tn)  -  N(tn- 1)  are  inde- 
pendent  of  each  other. 

P2)  Stationarity  of  Increments — N(t  +  h)  -  N (s  +  h)  has 
the  same  distribution  as  N[t)  —  N(s)  for  all  h  >  0  and 
0  <  s  <  t,  i.e.,  P{Ar(£  +  h)  —  N(s  +  h)  =  k}  is 
independent  of  h  >  0  and  equals  [A(£—s)]fc /A;!. 


will  admit  a  solution  in  the  ltd  sense  if,  on  an  interval  where 
N(t)  is  constant,  X  satisfies  X  =  f[X(t),t\  and  if  N(t)  jumps 
at  tn ,  X  behaves  in  the  neighborhood  of  tn  according  to  the  rule 
[23] 


X(tn+)  —  X(tn  —  )  +  g 


lim  X(t),t 

t'ltn 


n 


(6) 


where  X  =  dX/dt.  Note  that  the  jump  of  X(t)  at  time  tn  de¬ 
pends  on  the  value  of  g(X (£);£)  evaluated  at  a  time  just  before 
the  jump  of  N  (t) .  In  such  a  case  we  say  that  the  coefficient  func¬ 
tion  g[X (£);  t\  in  (5)  is  left  continuous  in  contrast  to  the  process 
N(t)  that  is  right  continuous.  The  increment  dN(a)  is  to  be 
interpreted  as  being  equal  to  N(o  +  da)  —  N(a).  With  this 
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understanding,  the  stochastic  differential  equation  (SDE)  corre¬ 
sponding  to  (5)  is  then  written  as 


dX(t)  =  t)dt  +  g(X(t);t)dN(t)  (7) 


where  dX(t)  represents  the  change  in  X(t)  when  t  changes 
infinitesimally,  i.e.,  dX(t)  =  X{t  +  dt)  —  X{t). 

Given  (7)  and  a  function  ^(x:t)  with  continuous  first  deriva¬ 
tives  in  both  x  and  t ,  we  have  the  following  Itb-Doeblin  rule  for 
the  jump  process  ^[X(t);t\  ([21],  Ch.  11),  [23]: 


[  dt  +  d~x  f{Xm) 
+  {TP(X(t-)  +  g[X(t-yt ]) 

-  1>(x{t-y,t)}dN(ty 


dt 

(8) 


When  the  Poisson  process  jumps  at  t  =  tn,  there  will  be  jump  in 
the  function  X ( t )  according  to  (6).  We  would  expect  i/;(X (t);  t ) 
to  jump  too  and  the  coefficient  of  dN  in  (8)  governs  the  size  of 
this  jump.  Again,  it  is  important  to  observe  that  the  jump  size 
is  governed  entirely  by  the  values  of  X (t)  and  g[X (£);  t\  evalu¬ 
ated  at  the  left  limit  tn  — .  Thus,  there  is  statistical  independence 
between  the  jump  in  N(t)  and  the  jump  it  causes  in  its  multi¬ 
plying  factor.  At  times  when  there  is  no  jump  in  N(t),  the  term 
involving  dN  would  vanish  and  one  obtains  the  usual  chain  rule 
formula  from  calculus  given  by  the  term  proportional  to  dt  in 
(8).  Keeping  these  in  mind  and  using  (4),  the  expectation  of  an 
incremental  process  of  the  type  dY(t)  =  h(X{t)\t)dN (t)  is 
interpreted  as 


random  time.  Fig.  1(b)  and  (d),  respectively,  show  sample  wave¬ 
forms  of  v(t)  and  ((t).  The  velocity  jumps  at  the  same  instants 
tn  when  N(t)  jumps  and  takes  values  of  ±1.  The  random  time 
((t)  is  continuous,  but  has  slope  discontinuities  at  tn.  If  there 
are  no  jumps  in  the  interval  (0 ,  £),  then  ((t)  =  t ,  otherwise 
((t)  E  (—t,  t\.  It  is  clear  that  in  an  infinitesimal  interval  dt 

dv  =  v(t  +  dt)  —  v(t) 

=  (-l)JV(t)[(-l)dJVW  -  1]  =  -2 v{t)dN(t).  (12) 

It  is  evident  from  Fig.  1(c)  that  the  coefficient  of  dN(t),  viz., 
v(t)  is  to  be  evaluated  at  t— ,  which  confirms  the  rules  laid  out 
in  Section  II- A  in  relation  to  (7).  Furthermore, 


t-\-dt  dt 


0 


where  the  +  sign  in  (13)  pertains  to  the  case  when  no  colli¬ 
sions  occur  in  the  time  interval  dt  and  the  —  sign  corresponds 
to  the  case  when  there  is  exactly  one  collision  in  the  infinites¬ 
imal  time  interval  dt.  The  relation  between  d(  and  v(t)  is  also 
clear  from  Fig.  1  (b)  and  (d).  The  following  properties  of  the  tele¬ 
graph  signal  can  be  established  from  the  definitions  of  the  cor¬ 
responding  quantities  and  the  properties  of  the  Poisson  process 
[24]: 


E  [dY(t)]  =  E  [h{X(t);t)dN(t)] 

=  E[h(X(t);t)]E[dN(t)] 

=  AE  [h(X(t);t)]dt  (9) 

because  the  function  h(X(t);t)  is  assumed  to  be  left  contin¬ 
uous  and  dN  is  right  continuous.  As  already  stated,  the  jump  in 
N(t)  is  assumed  to  take  place  first  independent  of  h(X(t);t) 
and  the  corresponding  jump  in  h(X{t)\t)  occurs  momentarily 
later.  Some  sort  of  causality  and  finite  speed  of  signal  propaga¬ 
tion  is  thus  inherently  assumed  in  processes  defined  by  dY  (t)  = 
h(X(t)]t)dN(t).  This  has  very  important  implications  in  fur¬ 
ther  analysis  as  we  will  show  in  Section  II-C. 

B.  Random  Time 


EM*)]  =  e~2Xt ,  (14) 

E[v(t  +  At)u(t)]  —  e-2A|At|.  (15) 

Using  these  we  can  show  that 

7i  W  =  E[C(i)]  =  e~Xt  sinh(Ai)/ A,  (16) 

AE[C(i  +  At)£(t)]  —  t  —  e~XAt  cosh(AAi)E[^(i)]. 

(17) 

Both  v{t)  and  ((t)  are  therefore  nonstationary  random  pro¬ 
cesses.  For  large  times,  71  (t)  ~  0.5/ A  and  AE[C2(£)]  ~  t. 
Hence,  the  standard  deviation  of  random  time  increases  as 
yjtj A  for  large  times. 


Consider  a  random  velocity 1  v(t)  (unitless)  and  a  corre¬ 
sponding  “position”  £(£)  (with  units  of  time)  defined  with 


respect  to  the  Poisson  process  N(t)  as 

Ui)  =  (-i)JV(t); 

t 

(10) 

b 

II 

42s 

Ks> 

(11) 

0 


Note  that  v{ 0)  =  1  and  C(0)  =  0.  Even  though  it  is  phys¬ 
ically  appealing  to  think  of  ((t)  as  the  position  of  a  particle 
whose  velocity  flips  randomly  between  —  1  and  +1,  the  fact  that 
it  has  units  of  time  render  it  to  be  termed  more  appropriately  as 


C.  Relation  Between  Wave  and  Telegrapher  s  Equations 

Consider  now  a  function  and  define  the  deterministic 
function  ip(t)  —  E[tp(((t))],  i.e.,  ip(t)  is  obtained  from  tp{t) 
by  replacing  the  actual  time  variable  t  with  the  random  time 
((t)  and  then  performing  an  averaging  operation  with  respect 
to  the  underlying  jump  process.  Using  (8),  (9),  (12),  (13),  and 
the  commutation  of  the  expectation  and  differential  operators 

dip{t)  =  E  [#(C)]  =  E  [u(t)ip' (Q]dt 

d2ip(t)  =  E[dv(t)il)'  (Q  +  v(t)d(ip'  (())]dt 

=  -2E[is(t)i/;\()dN]dt  +  E[v2  (()](dt)2 

=  {-2AEKt)V’'(C)]  +  E[V’"(C)]}(^)2 

=  —2\dip(t)dt  +  E[ip"(()](dt)2. 


Tn  the  literature  v(t)  is  referred  to  as  the  semi-random,  telegraph  signal  [24]. 


(18) 
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In  other  words, 


d2p(t) 

dt2 


+  2A 


dp(t) 

dt 


E[V>"(0]  =  E 


d2fijj(t) 

dt2 

(19) 


where  ^'(C)  =  d^t) / dt\t=^  denotes  the  derivative  with  re¬ 
spect  to  its  argument.  The  first  line  in  the  expansion  for  dV 
above  is  valid  for  terms  up  to  order  dt2;  higher  order  terms 
vanish  in  the  limit  of  dt  — >•  0  in  the  eventual  quantity  of  in¬ 
terest  d2p/dt2 .  If  i/j  and  p  depend  additionally  on  the  spatial 
coordinates  r  =  (x,  y ,  z),  i.e.,  =  ^(r;  t)  and  ^  is  a  solution 

of  the  partial  differential  equation  (PDE) 


d2% b 
~dt? 


Lr'l/j 


(20) 


where  Lr  is  some  linear  operator  with  respect  to  the  spatial  co¬ 
ordinates,  subject  to  the  initial  conditions  ^(r;  0)  =  /( r)  (this 
can  be  thought  of  as  the  specification  of  an  initial  position)  and 
d^(r;t  =  0 )/dt  =  g( r)  (this  can  be  thought  of  as  the  speci¬ 
fication  of  an  initial  velocity ),  then  the  term  inside  the  expecta¬ 
tion  operator  on  the  right-hand- side  of  (19)  will  be  of  the  form 
d2ilj/dt2  |t_£(t),  which  is  equal  to  Lr'i/j\t=(^^ty  Hence, 

<p(r;t)  =  E[ip(r;t  =  C(t))]  (21) 


with  ^(r;t)  given  by  (20)  satisfies  the  PDE 

d2p  dp 

-w+2XIt=L*«  (22) 

with  the  same  initial  conditions,  viz., 

¥>(r;  t  =  0)  =  /( r)  and  — —  =  9(r)  (23) 


where  we  have  used  £(0)  =  0  and  u(0)  —  1  in 
<p(r;0)  =  E[^(r;C(0)]  =  /(r)  and  dip(r;  t  =  0 )/dt  = 
E[dC/dtd'ip(r;C)/dC\t=0]  =  E[u(0)dip(r;t  =  0  )/dt\  =  g(  r) 
in  establishing  (23).  It  is  seen  that  when  a  field  quantity 
satisfies  an  operator  equation  that  involves  a  second-order  time 
derivative  term,  the  effect  of  replacing  the  time  variable  in 
the  original  field  quantity  with  the  random  time,  followed  by 
averaging  with  respect  to  the  underlying  Poisson  process,  has 
the  effect  of  introducing  a  new  field  variable  that  satisfies  a 
modified  operator  equation  containing  an  additional  first-order 
time  derivative  term.  The  coefficient  of  the  first-derivative 
term  is  proportional  to  the  average  arrival  rate  of  the  Poisson 
process.  The  initial  conditions  for  the  modified  field  remain  the 
same  as  the  initial  conditions  for  the  original  field.  As  a  special 
case,  if  the  original  field  ^  satisfies  the  scalar  wave  equation 
with  Lr  =  v2V2,  where  v  is  the  propagation  speed,  then  the 
new  field  p  satisfies  the  reduced  Telegraphers  equation  (or 
the  lossy  wave  equation) 


82p 

~dt? 


v2V2ip. 


(24) 


This  remarkable  result  was  first  demonstrated  in  1-D  by  Kac 
in  [18]  using  an  entirely  different  mathematical  machinery.  His 
conjecture  that  it  continues  to  be  valid  for  higher  dimensions 
has  been  formally  proven  here  using  concepts  from  stochastic 


calculus.  An  elementary  application  of  Kac’s  result  is  that  the 
solution  for  the  current  in  a  series  linear  RLC  circuit  can  be 
obtained  in  terms  of  the  current  of  a  the  lossless  LC  circuit  when 
the  time  variable  is  replaced  with  random  time  having  parameter 
A  =  R/2L. 

What  is  even  more  interesting  is  that  this  kind  of  correspon¬ 
dence  is  not  limited  to  wave  equation  alone,  as  is  clearly  evident 
from  (22).  In  most  literature  (24)  is  itself  referred  to  as  the  teleg¬ 
rapher’s  equation  although  a  clarification  is  in  order.  The  teleg¬ 
rapher’s  equation  was  originally  derived  for  a  lossy  transmis¬ 
sion  line  having  parameters  R:  G:  L,  and  C;  respectively,  the 
series  resistance,  the  shunt  conductance,  the  series  inductance, 
and  the  shunt  capacitance  per  unit  length,  all  being  nonnegative. 
With  a  =  G/C,  (3  =  R/L  and  v  =  1/y/LC,  the  telegrapher  s 
equation  for  the  voltage  V(z;t)  along  the  line  reads 


d2V 


dV  d2V 

+  (“  +  Z3)  ~dt  +  a^V  =  1,2  ~dz 2 


(25) 


where  z  is  the  space  variable.  With  the  change  of  variable  V  = 
e~ktp:  where  k  =  min  (a,  /?),  one  gets  the  equation 


d2V  ,  ,  md<p  2 d2V 

aF  +  l“-/3|ar  =  *’  a? 


(26) 


which  is  seen  to  be  the  reduced  telegrapher’s  equation  in  1-D 
with  the  parameter  2 A  =  \a  —  /3\.  In  the  case  of  a  =  /3,  (26) 
reduces  to  the  wave  equation.  Equation  (26)  is  also  the  equation 
satisfied  by  a  wave  propagating  in  a  linear,  homogeneous  con¬ 
ducting  medium  characterized  by  the  usual  electrical  parameters 
(e,  /i,  cr)  [25].  The  quantity  v  —  1/  ^JJTe  is  the  speed  of  light  in  a 
lossless  medium  with  parameters  (e,  p),  and  T  =  1/2A  =  el  a 
is  the  relaxation  time  of  charges  in  the  conducting  medium. 

Using  the  d’Alembert’s  formula  for  the  solution  of  a  wave 
equation  in  1-D  [25],  [26],  the  solution  of  the  corresponding 
lossy  wave  equation  in  an  unbounded  medium  with  the  initial 
conditions  given  in  (23)  can  be  expressed  from  the  stochastic 
representation  (21)  as 


<p(z;t)  =  E 


f(z  +  v((t))  +  f(z-vC{t)) 


z+vQ{t) 

A  /  ^ 

z-v£(t) 


.  (27) 


Equation  (27),  with  the  random  time  ((t)  replaced  by  the  deter¬ 
ministic  time  variable  t  and  the  expectation  operator  removed, 
is  simply  the  d’Alembert’s  formula  given  in  [25],  [26]  for  the 
solution  of  a  wave  equation  in  1-D.  Kac  [18]  only  considered 
the  case  with  zero  velocity  (i.e.,  with  g(x)  =  0),  but  (27)  gen¬ 
eralizes  his  result.  We  may  use  (21)  and  (27)  to  establish  some 
useful  stochastic  identities.  Equation  (27)  can  be  put  in  a  more 
suitable  form  if  the  initial  data  are  expressed  in  terms  of  their 
Fourier  transforms.  The  function  f(z)  and  its  Fourier  transform 
F(kz )  are  related  by  the  usual  transform  relationship 

oo 

/(*)  =  T  /  F(kz)eik‘*  dkz.  (28) 
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Using  a  similar  definition  for  g(z)  and  substituting  into  (27)  we 
arrive  at 

oo 


27 T<p(z]  t ) 


E  [cos (kzv((t))]  dkz 


—  oo 


+ 


OU 


(29) 


wish  to  determine  the  probability  density  function  (pdf)  p(r;  t) 
defined  by  P[o;  E  U;C(£;u;)  E  (r,  r  +  dr)]  =  p(r]t)dr. 
r  E  (— Ml  -  It  will  demonstrated  later  in  this  section  that  the 
pdf  p(r;  £)  itself  satisfies  the  reduced  telegrapher’s  equation  in 
1-D  with  r  taking  the  place  of  the  spatial  variable.  As  it  is  more 
convenient  to  first  generate  the  transform  of  p(r;  £),  we  define 
the  transform  function  P(n;  s )  which  is  obtained  from p(r;  i)  by 
taking  the  Laplace  transform,  L,  with  respect  to  t  and  Fourier 
transform,  F ,  with  respect  to  r: 


This  alternate  form  is  sometimes  advantageous  because  the  av¬ 
eraging  operation  has  been  transferred  to  known  functions.  The 
explicit  solution  for  the  lossy  wave  equation  in  1  -D  is  given  in 
[26] 


ip(z;t)  =  e 


-A t  /  f(Z  +  Vt )  +  f(z  ~  Vt ) 


1 


z-\-vt 


/( 0  (  A  +  )  +0(0 


•7o  A2*2  -  -  02)  |  (30) 


where  70(  • )  is  the  modified  Bessel  function  of  the  first  kind  of 
order  0.  Equations  (27),  (29),  and  (30)  may  be  equated  to  each 
other  to  yield  a  number  of  interesting  results.  For  instance  using 
z  =  0  and  f(z )  =  0,  we  get 


E 


v((t) 

I  9(0  dt 


\rvC(t) 


(31) 

Note  as  already  indicated  that  the  quantity  v( (t)  could  be  posi¬ 
tive  or  negative  even  if  t  is  positive.  If  g(£)  is  chosen  such  that 
the  left-hand  side  and  the  right-hand  side  integrals  in  (3 1)  could 
be  evaluated  in  a  closed  form,  certain  useful  relations  could  be 
obtained.  As  an  example,  with  g(£)  =  e~</vt ,  we  can  show 


that  [27] 


E 


sinh 


ae 


—  At 


\J  a2  +  X2t2 
d 


sinh 


-At 


da 


cosh 


a 2  +  A  2t2^ 

)]■ 


(2  +  A 2*2  ’ 


(32) 


P(k;s)=  j  e~st  j 

t— 0  r=  — oo 


p(r;t)e  lKr  drdt 


=  L(F\p(r-,t)])=L(  E 


) 


(33) 


where  i  —  >/— T-  The  use  of  Fourier-Laplace  transform  in  the 
solution  of  linear  PDEs  with  constant  coefficients  is  a  standard 
procedure  and  documented  in  a  number  of  books,  including 
[28].  From  (8),  (12),  (13),  and  using  the  fact  that  u2(t)  =  1, 
we  get 

d  (e-iKC(t))  =  -iKv(t)e-iK(Wdt,  (34) 

and 

d  (v(t)e-iKCW^  =  —[indt  +  2v(t)dN(t)}e~iKCW . 

(35) 


To  facilitate  further  analysis  we  let  ui(k;  t )  =  E[e-*^^]  and 
w2(«;t)  =  E Then  taking  expectation  on  both 
sides  of  (34)  we  have 


dui(hc;  t ) 
dt 


—  IKU2{^  t ). 


(36) 


Similarly,  taking  the  expectation  on  both  sides  of  (35)  and 
making  use  of  (9)  we  get 

chWftU)  /x  x  /  x  ^  x 

- — - =  t)  +  2\u2(k]  t).  (37) 


Equations  (36)  and  (37)  constitute  a  system  of  coupled,  linear 
first-order  ordinary  differential  equations.  Using  E[u(0)]  =  1 
and  k  =  0  in  (37)  and  solving  for  w2(0;0  recovers  (14).  If 
we  now  take  Laplace  transform  with  respect  to  t  on  both  sides 
of  (36)  and  (37)  and  use  the  usual  properties  of  the  Laplace 
transform  of  the  derivative  of  a  function,  we  arrive  at 


This  identity  could  be  used  to  find  the  nth  moment  7  n(t)  = 
E[(n]  for  any  n.  For  example,  differentiating  both  sides  of  (32) 
with  respect  to  a  and  evaluating  at  a  =  0  yields  7i(t)  = 
exp  (—At)  sinh  (At)  /A  for  the  first  moment  of  £(t),  which  agrees 
with  that  given  in  (1 6).  The  2-D  version  of  the  main  result  in  (2 1 ) 
was  also  used  in  [27]  to  derived  some  useful  integral  identities 
encountered  in  wave  propagation  area. 


sP  —  —  inQ  +  ui(n;  0)  (38) 

sQ  =  —inP  —  2A Q  +  n2(n;  0)  (39) 

where  Q(k;s)  =  L[n2(n;t)]  and  P(k;s)  is  defined  in  (33). 
Using  ui(k;0)  =  E[l]  =  1  andn2(n;0)  =  E[n(0)  •  1]  = 
E [1]  =  1  and  solving  the  simultaneous  equations  (38)  and  (39) 
we  finally  get 


D.  First-Order  Statistics  of  the  Random  Time 

In  view  of  the  central  role  played  by  random  time  in  the  sto¬ 
chastic  representation  of  the  solution  of  the  telegrapher’s  equa¬ 
tion  such  as  in  (27),  it  is  of  interest  to  determine  the  distribu¬ 
tion  of  the  random  variable  ((t)  for  a  fixed  t  on  the  probability 
space  (U,  P),  where  U  denotes  sample  space.  Consequently,  we 


P(k;s ) 
Q(k;s) 


(s  +  2A)  —  in 

s 2  +  2A  s  +  n2 
s  —  in 

s 2  +  2As  +  n2 


(40) 

(41) 


Equation  (40)  is  also  derived  in  [29],  but  using  the  expressions 
of  the  Laplace  transform  of  the  various  moments  provided  in 
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[18].  However,  the  approach  taken  in  this  paper  is  more  straight¬ 
forward  and  as  a  bonus  one  can  derive  expressions  for  other 
quantities  of  interest  such  as  Q(n;  5).  If  P(n;  s)  is  evaluated  at 
k  —  0  and  the  inverse  Laplace  transform  taken,  one  gets 


00 

/ 


p(r;  t )  dr  =  0(f)  =  1,  f  >  0 


(42) 


verifying  that  p{r\  f)  is  a  valid  candidate  for  pdf  for  t  >  0.  It  is 
also  interesting  to  note  from  (40)  that  the  pdf  p(r;t)  itself  sat¬ 
isfies  the  reduced  telegrapher’s  equation.  Indeed,  for  a  function 
w(r]t)  satisfying  the  reduced  telegrapher’s  equation  d2w/dt2+ 
2A dw/dt  =  v2d2w/dr 2  with  initial  conditions  p(r;  0)  =  po(r) 
and  dp(r;  t)/dt\t=o  =  vo(r),  the  Fourier-Laplace  transform 
W(k;s)  satisfies 


W(^s)  = 


( 8  +  2\)pq(k,)  +  Vo  (k) 
s2  +  2A  s  +  n2v2 


(43) 


where  po(^)  =  F\po(r)]  and  vq(k)  =  F[vo(r)].  Comparing 
(43)  with  (40),  we  see  that  p(r;  t)  satisfies  the  reduced  teleg¬ 
rapher’s  equation  in  1-D  with  the  speed  v  =  1,  po{n)  =  1, 
vo(k)  =  —in,  the  latter  translating  to  the  initial  conditions 
Po(r)  =  S(r)  and  vo (r)  =  S'(r)  =  dpo(r)/dr.  These  initial 
conditions  make  perfect  sense  in  view  of  the  fact  that  £(0)  =  0 
deterministically.  Likewise,  the  inverse  transform  of  Q(n;  s) 
satisfies  the  same  reduced  telegrapher’s  equation,  but  with  ini¬ 
tial  conditions  q(r;  0)  =  S(r)  and  dq(r;  t)/dt\t=o  =  6'(r)  — 
2A  6{r). 

The  pdf  p(r;t )  is  obtained  from  the  inverse  relation 


p{r;t) 


s  +  2A  -  in  t  • 

— - - - -esteinr 

s 2  +  2A  s  +  n2 


dsdhi 


(44) 


where  the  contour  T  is  a  straight  line  parallel  to  imaginary  axis 
in  the  complex  5 -plane  such  that  all  singularities  lie  to  the  left 
of  it.  The  integrand  has  simple  poles  at  s  1  =  —  A  ±  i\/ n2  —  A2 

2 

in  the  complex  s -plane.  The  Laplace  inversion  may  be  carried 
out  by  elementary  means  and  the  result  is 


p(r\t)  = 


-A  t 


27 r 


00 

/ 


cos(\/ n2  —  A2  t) 

sin(  V k2  —  A2  t) 


+  (A  —  in)~ 


^k2  -  A2 


emr  dn.  (45) 


Along  the  same  lines,  the  functions  t),  which  relate  to 

the  mean  of  the  stochastic  processes  e-mC(*)  and  u(t)e~lK^ 
can  be  shown  to  be 


u\  (k;  t)  —  e 


-A  t 


COS  \J K2  —  A 2t 


±  sin  yK2-A2 1 

^  -  A2 


•  (46) 


Defining 


.1  1  i 

27T  J  \J k2  —  A2 


(47) 


the  pdf  in  (45)  could  be  expressed  as 

extp(r;t)  =  Pl(r;t).  (48) 

To  evaluate  the  integral  in  (47)  we  use  the  identity  [26,  p.  303] 

l  ju\V^¥)e*"dr  (49) 


where  J0(  • )  is  the  Bessel  function  of  the  first  kind  of  order 
0.  This  equation  demonstrates  a  Fourier  transform  relationship 
between  the  function  sin(  • )/( • )  and  the  Bessel  function  J0  ( • ) . 
The  Fourier  inverse  desired  in  (47)  is  then  equal  to 

Pi(r;t)  =  lloOV*2  -  r2 )Rt(r )  (50) 

where  Rt  (r)  is  a  unit- valued  rectangular  pulse  function  centered 
at  the  origin  and  of  support  r  G  (—£,£],  and  we  have  used  the 
fact  that  Io(x)  =  Jo{ix).  Using  this  in  (48),  the  pdf  is  finally 
obtained  as 


P(r;t)  =e  f  <  6(t  -  r)  +  - 


+  (r  +  f) 


Io(Xy/ t 2  —  r 2) 

/l(A\A2  —  T2) 


yj  t2  —  r2 


for  r  G  (— t,  t\,  t  >  0.  (51) 


This  is  a  new  result  for  the  pdf  of  the  random  time  and  has  not 
been  derived  before,  although  an  expression  for  the  even  part  of 
it,  viz.,  h(r ;  t)  =  p(r;  t )  +  p(— r;  t)  without  the  delta  function 
term  is  available  in  [29].  It  is  also  different  from  the  expression 
given  in  [13]  and  [19],  because  these  works  assume  different 
initial  conditions  that  do  not  pertain  to  the  random  time  ((t) 
that  we  are  considering  in  the  paper.  It  is  seen  that  the  pdf  in 
(51)  is  asymmetric  in  r  as  it  should  be  because  ((t)  =  +t  until 
the  time  first  jump  occurs,  indicating  that  the  random  time  is 
skewed  towards  positive  times.  Furthermore,  the  mean  value, 
7i(t),  of  ((t)  per  (16)  is  71(f)  =  exp(  — At)  sinh(Af)/A,  im¬ 
plying  that  the  pdf  cannot  be  symmetric  about  r  =  0.  The  ex¬ 
pression  given  in  [19]  is  symmetric  and  even  though  it  is  a  solu¬ 
tion  to  the  reduced  telegrapher’s  equation,  the  pdf  does  not  cor¬ 
respond  to  ((t).  The  delta  function  contribution  in  (51)  arises 
from  the  event  when  there  are  no  jumps  in  the  interval  (0,  t) 
and  this,  we  know,  happens  for  the  Poisson  process  with  a  prob¬ 
ability  e~Xt.  The  remaining  terms  are  due  to  various  jumps  hap¬ 
pening  between  (0,  t).  Fig.  2  shows  a  plot  of  p(r;  t )  for  A  =  0.1 
s-1,  t  =  60  s,  compared  with  numerical  simulations  generated 
with  Nr  =  106  realizations  for  the  random  time  ((t).  For  the 
parameters  chosen,  the  expected  number  of  jumps  in  the  interval 
(0,  t)  is  Xt  —  6.  The  delta  function  has  been  excluded  in  the  an¬ 
alytical  data  shown  in  Fig.  2.  The  asymmetry  in  r  and  the  spike 
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Fig.  2.  PDF  p(r;  t)  of  the  random  time  for  t  =  6  Os. 


where  the  electric  polarization  Pz  is  related  to  the  electric  field 
Ez  via 

+  7^  =  eo u2pEz  -  (jJqPz .  (55) 

The  left-hand  side  of  (55)  is  similar  to  that  of  (26),  thus  permit¬ 
ting  stochastic  formulation.  It  may  be  interesting  to  note  that  the 
average  rate,  A,  of  the  Poisson  process  determining  the  random 
time  £(£)  has  a  physical  interpretation  here  in  that  it  is  directly 
proportional  to  the  collision  frequency,  7,  of  electrons  within 
the  medium  comprising  the  model.  Indeed  2A  =  7  for  the 
Lorentz/Drude  media.  By  considering  the  particular  solution 

t 

Qz(x;  t)  =  e0ujp  f  -Ez(a;;Ti)Sma;0^ — —dr i  (56) 

J  <^0 

—  oo 

of  the  inhomogeneous  wave  equation  corresponding  to  (55): 

^^+ujlQz=t0w2pEz  (57) 


emerging  at  r  =  tin  the  numerical  results  are  clearly  seen  from 
the  plot. 


E.  Application  to  Pulse  Propagation  in  Dispersive  Media 

In  this  subsection,  we  will  demonstrate  how  the  stochastic 
model  developed  in  the  foregoing  sections  can  be  applied  to  de¬ 
rive  some  useful  field  relations  in  pulse  propagation  in  causal 
dispersive  media.  We  will  consider  2-D  Maxwell’s  equations, 
together  with  the  commonly  used  dielectric  dispersion  models 
of  Lorentz  and  Drude  [30].  Extension  to  3-D  and  other  disper¬ 
sion  models  can  be  proceeded  along  the  same  lines.  Recall  that 
the  permittivity  expression  for  a  Lorentz  model  is  derived  by 
treating  the  interaction  of  a  bound  electron,  itself  represented  as 
a  damped  harmonic  oscillator,  under  the  influence  of  a  harmonic 
electric  field  [31].  Assuming  an  e~XU}t  time  convention,  where 
uj  is  the  radian  frequency,  the  complex  dielectric  permittivity  of 
a  single  resonance  Lorentz  model  is 


=  1  - 


(a;2  +  -  cJq  ) 


:=  1  +  Xe(oj) 


(52) 


where  cup  is  the  plasma  frequency,  7  is  the  damping  constant 
resulting  from  collisions  of  electrons  in  the  medium,  ujo  is  the 
resonant  frequency  of  the  oscillator,  and  Xe{u)  is  the  electric 
susceptibility.  When  lu0  =  0,  the  model  is  known  as  the  Drude 
model  and  is  used  in  optical  propagation  in  conductors  as  well 
as  in  radiowave  propagation  in  the  ionosphere  [32].  Lor  many 
practical  media,  including  ionosphere  and  seawater,  7  <  lup. 

Consider  2-D  ( d/dy  =  0)  electromagnetic  fields  (Ez,Hy) 
that  evolve  in  a  semi-infinite  Lorentz  or  Drude  medium  (x  >  0) . 
The  field  components  are  related  through  Maxwell’s  equations 
by 


dEz 

dHy 

dx 

dt  ’ 

8Hy 

dEz 

dPz 

dx 

~  60  dt  + 

dt 

(53) 

(54) 


the  stochastic  representation  of  Pz  can  be  obtained  as 


Pz(x;t)  =  e0Wp  E 


cw 

J  Ez(x:ti) 


sinw0(C (t)  -  ri) 


w0 


dri 


which  could  be  substituted  back  into  (54)  to  yield 

1  dHy  8EZ  2  ^  x 
a-  +LJ2pF(x-,t) 


6q  dx 


dt  p 


(58) 


(59) 


where 


CW 

f‘ 

\ 

F(x ;  t)  =  31  < 

E 

v(ty^at)  /  £z(x;ri)e-“°Tl  dn 

> 

l 

—  00 

(  r  r\ 

Vo) 


and  5R(  • )  denotes  real  part  of.  The  system  comprised  of  (53) 
and  (59)  can  then  be  solved  for  (Ez:Hy)  subject  to  boundary 
conditions  specified  at  x  =  0.  The  system  may  also  be  imple¬ 
mented  using  numerical  schemes  such  as  finite-difference  time 
domain  (LDTD)  [33]  to  update  (Ez,Hy)  in  time  and  space.  In 
numerical  implementations  it  would  be  necessary  to  examine 
how  the  quantity  F(x;t)  evolves  in  time.  Using  properties  (PI) 
and  (P2)  of  the  Poisson  process,  we  can  establish  the  following 
exact  relation  valid  for  any  At  >  0: 


F(x;t  + At)  = 


g(t,  A t)F(x-,t) 

v{t  +  At)ei“oC(t+At) 


+  E 


C(*+At) 

x  f  Ez(x;T1)e~luJ°Tl  dri 

a*) 


(61) 
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where 


g(t,  At)  =  E  (v{t)v{t  +  Ai)ei“o[c(*+A*)“c(t)1)  .  (62) 

Hence,  it  is  seen  that  a  knowledge  of  the  correlation  function 
of  the  complex- valued  random  process  v(t)  exp[zcuoC(0]  *s  re' 
quired  to  update  the  field  F(x\t).  The  mean  of  this  random 
process  is  given  by  the  function  w2(ft  =  —cuq ;t)  considered 
in  Subsection  II-D  and  its  correlation  function  is  given  by  (76) 
in  the  Appendix. 

Owing  to  simplicity,  we  will  henceforth  consider  the  Drude 
medium  (cuo  =  0)  and  derive  some  useful  relations  for  the 
evolution  of  the  field  F(x;t).  However,  the  more  general  case 
with  wq  /  0  can  be  treated  in  a  similar  manner.  From  the 
second-order  statistics  given  in  (15),  we  see  that  the  exact  evo¬ 
lution  equation  for  the  Drude  medium  is 


F(x;  t  +  At)  =  e^AtF(x]  t)  +  E 


v(t  +  At) 


C(t+Ai) 

X  /  E^r^drx 

C  it) 


(63) 


It  is  seen  from  (63)  that  the  future  value  of  F{pc\  t )  depends  on 
its  present  value,  on  the  statistics  of  the  jump  process  in  the 
time  interval  (t,t  +  At),  on  the  telegraph  signal  v(t  +  At) 
and  on  the  electric  field  values  in  the  interval  (£(£),  ((t  +  At)). 
Equation  (59)  together  with  (63)  may  be  compared  to  the  cor¬ 
responding  equation  that  appears  in  the  recursive  convolution 
method  of  FDTD  formulations  that  is  used  to  treat  propagation 
in  linear,  dispersive  media  [33].  The  convolutional  integral  there 
involving  dxe(t)/dt  and  Ez(x ;  t)  is  replaced  in  the  stochastic 
formulation  with  the  last  term  on  the  right-hand  side  of  (59).  The 
benefit  of  not  having  a  convolutional  integral  is  somewhat  offset 
by  the  appearance  of  the  expectation  operator  and  the  random 
upper  limit  of  the  inner  integral  in  (60)  in  the  stochastic  formula¬ 
tion.  If  7 A t  <  1  as  used  in  many  FDTD  calculations  [34],  [35] 
([35]  uses  7 /uop  =  6.732  x  1(T3,  7A t  =  2.61  x  1(T4,  [33] 
uses  7 A t  =  2.564  x  1CU2),  the  expected  number  of  collisions 
in  an  interval  At  as  given  by  (4)  is  equal  to  0.  In  such  a  case 
N(t  +  At)  —  N(t)  «  0,  v(t  +  At)  «  v(t),  ((t  +  At)  —  ((t)  « 
v(t)At  (see  (13),  and  we  get  from  (63)  on  using  v2(t)  =  1  the 
approximate  evolution  equation 


F(x;  t  +  At)  «  e~lAtF(x]  t)  +  At  E [Ez(x;  C(*))]  (64) 


on  assuming  the  electric  field  to  remain  constant  in  the  interval 
\((t  +  At)  —  £(£)|  <  At.  Thus,  the  updated  field  F(x\  t  +  At) 
depends  on  the  current  field  F(x;t)  and  the  expected  value  of 
Ez(x;  t)  at  the  random  time  t  =  ((t).  It  is  safe  to  say  that  (64) 
will  continue  to  hold  for  larger  At  such  that  7 A t  <  0.1.  In  fact, 
the  probability  of  having  no  collisions  in  an  interval  At  from 
(3)  is  e~XAt  >  0.95  for  7 A t  =  0.1.  In  numerical  computa¬ 
tions,  the  field  in  normally  evaluated  over  a  uniform  temporal 
grid.  So,  some  sort  of  interpolation  will  be  involved  in  com¬ 
puting  the  last  term  in  (64).  Furthermore,  since  the  standard  de¬ 
viation  of  ((t)  increases  as  \ft  for  large  t  [see  (16)  and  (17)], 


more  computations  will  be  required  at  longer  times  to  imple¬ 
ment  the  expectation  operator  in  (64)  and  the  computation  time 
involving  (54)  and  (64)  will  approximately  increase  as  0{y/i) 
in  time.  This  increase  in  computations  at  long  times  is  also  true 
for  numerical  schemes  employing  the  traditional  convolutional 
integral.  It  remains  to  be  seen  whether  the  representation  (59) 
together  with  the  approximate  evolution  equation  (64)  will  re¬ 
sult  in  more  accurate  or  more  stable  numerical  schemes  than  the 
ones  currently  used  in  FDTD.  In  this  regard,  one  has  to  weigh 
in  the  operation  count  of  the  entire  algorithm  as  well. 

There  is  an  alternative  viewpoint  in  which  the  random 
time  manifests  in  frequency-dependent  dispersive  media.  The 
second-order  equation  satisfied  by  a  Cartesian  component  of  the 
electromagnetic  field,  E,  in  a  homogeneous,  isotropic,  locally 
linear,  temporally  dispersive  medium  with  no  externally  sup¬ 
plied  sources  is  the  Helmholtz  equation  v2V2E  +  uj2ercE  =  0, 
where  v  =  l/^//ioeo  is  the  speed  of  light  in  free-space.  The 
exact  (pseudo)  differential  equation  for  the  time-dependent 
field  component  £,  keeping  in  mind  that  a  factor  —iuo  in  the  fre¬ 
quency  domain  translates  to  the  operator  d/dt  in  time-domain, 
for  the  Drude  medium  is 


'V2£- 


d2s 
dt 2 


<4  it 
6  + 1) 


£  =  0. 


(65) 


This  equation  is  not  directly  amenable  to  treatment  by  the  sto¬ 
chastic  model  presented  in  this  paper.  However,  in  the  low-fre¬ 
quency  regime  where  u  <C  7  <  u>p,  the  complex  dielectric  con¬ 
stant  approximates  to  ercu;2  ~  J2  +  zcu/r0,  where  r0  =  7 /uj2 
and  the  exact  equation  (65)  approximates  to 


u2V2£  - 


d28  1  d£ 


dt 2 


- "57  ~  0 

to  dt 


(66) 


which  is  identical  to  the  modified  Telegraphers’s  equation  (24) 
considered  in  this  paper.  At  these  low  frequencies,  the  statistics 
of  the  Poisson  process  in  the  stochastic  model  are  governed  by 
the  damping  constant  as  well  as  the  plasma  frequency.  On  the 
other  hand,  at  high  frequencies  where  uj  7,  the  dielectric 
constant  approximates  to  ercuj2  ~  uj2  —  uj2  and  (65)  reduces 
to  the  Klein-Gordon  equation  [25],  [36]  (which  is  a  relativistic 
version  of  the  time-dependent  Schrodinger  equation) 

=  (67) 


It  is  not  uncommon  in  electromagnetic  pulse  propagation 
studies  to  consider  limiting  cases  such  as  these  to  facilitate 
asymptotic  analysis  [37].  Notwithstanding  this,  it  is  still  of 
interest  to  develop  a  stochastic  model  for  the  exact  equation 
(65)  valid  at  all  frequencies. 


III.  Conclusion 

Using  stochastic  calculus  pertaining  to  jump  processes,  we 
have  in  this  paper,  established  Kac’s  conjecture  that  the  solu¬ 
tion  of  a  modified  telegrapher’s  equation  can  be  expressed  in 
terms  of  the  solution  of  a  wave  equation  by  simply  replacing 
the  time  variable  with  random  time  generated  from  a  Poisson 
process.  We  are  able  to  demonstrate  this  for  arbitrary  initial  con¬ 
ditions  and  for  linear  PDEs  more  general  than  the  wave  equation 
that  contain  second-order  time  derivatives.  An  expression  has 


2743 


37 

JANASWAMY:  ON  RANDOM  TIME  AND  ON  THE  RELATION  BETWEEN  WAVE  AND  TELEGRAPH  EQUATIONS 


been  derived  for  the  probability  density  function  of  the  random 
time  and  it  is  shown  that  the  pdf  itself  satisfies  the  modified  te¬ 
legrapher’s  equation.  This  expression  is  more  general  than  the 
currently  available  expression  in  the  literature  that  is  applicable 
only  to  the  even  part  of  the  random  time. 

The  theory  presented  in  the  paper  is  applicable  to  waves  prop¬ 
agating  in  a  conducting  medium,  including  the  case  where  the 
conductivity  (or  more  generally  where  the  complex  relative  per¬ 
mittivity)  is  frequency  dependent.  Accordingly,  the  concept  of 
random  time  was  applied  to  pulse  propagation  in  dispersive 
media  in  Subsection  II-E  and  new  update  equations  for  the  field 
components  have  been  derived  that  should  find  utility  in  numer¬ 
ical  implementations  such  as  FDTD.  In  particular  Lorentz  and 
Drude  media  were  considered  in  the  paper  and  we  have  shown 
that  the  computation  time  for  field  evaluation  goes  up  in  time  as 
0(y/t).  Application  to  more  complicated  media  such  as  those 
characterized  by  multiple  resonant  Lorentz  model  is  underway 
and  will  be  reported  in  a  future  paper.  It  would  also  be  inter¬ 
esting  to  derive  higher  order  evolution  approximations  to  the 
field  F(x\t)  by  equating  the  probability  of  having  fewer  that 
k  collisions  in  an  interval  At  to  a  given  number  and  then  de¬ 
termining  k  from  it.  This  should  facilitate  development  of  nu¬ 
merical  schemes  with  some  sort  of  error  control.  For  instance 
approximation  (64)  has  been  derived  under  the  assumption  of 
having  no  collisions  in  an  interval  At,  but  the  probability  of  no 
collisions  in  an  interval  At  is  e~XAt.  By  setting  this  probability 
to  a  given  number  less  than  unity,  one  should  be  able  to  deter¬ 
mine  the  maximum  permissible  At  for  this  approximation.  Such 
studies  will  be  taken  up  in  the  future. 

The  concept  of  random  could  be  utilized  to  extend  the  ana¬ 
lytical  solution  of  wave  propagation  problems  that  are  available 
only  for  lossless  media.  For  instance,  the  Cagniard-de  Hoop 
method  [38]  has  been  applied  in  the  past  to  treat  transient  ra¬ 
diation  arising  in  certain  nonconducting,  boundary  value  prob¬ 
lems  [39],  [40].  It  should  be  possible  to  extend  the  expressions 
provided  in  these  works  to  the  corresponding  lossy  media  by 
simply  replacing  the  time  variable  with  the  random  time  and 
performing  an  expectation  with  respect  to  the  Poisson  process, 
thereby  increasing  the  utility  of  the  Cagniard-de  Hoop  method. 


Appendix 

Correlation  Function  of  u(t)eiuJoC^ 

Define 


g(v,  0  =  E  \v(rj)v(ri  +  £)e*“o[C(»j+€)-C(»>)]  j  )  (68) 

and 

0  =  E  }  .  (69) 

Then  it  is  clear  from  using  (14)  and  (15)  that 


g(v,  o)  =  i,  (70) 

hi(v,  0)  =  e-2V  (71) 


Using  (9),  (12),  and  (13),  it  can  be  established  that  for  £  >  0 


and 


dg 


— 2A  g  +  ituohi, 


iu>og. 


From  (70),  (71)  and  (72),  we  see  that 


dg_ 


e=o 


-2\  +  uuoe~2Xv  ■ 


(72) 

(73) 


(74) 


A  second-order  equation  for  g  can  be  obtained  on  combining 
(72)  and  (73): 


cfg 

<9£2 


2A| 


+  g  —  o 


(75) 


which  can  be  solved  by  standard  means  for  the  initial  conditions 
specified  in  (70)  and  (74)  to  yield 


0(^0  = 


cosh(p^)  — 


A  —  iuj^e 


—  2\j) 


P 


■  sinh(p^) 


(76) 


where  p  =  s/\2  —  cuq.  As  a  quick  check,  g(rj ,  £)  =  e  2A^  when 
cvo  =  0,  a  result  that  agrees  with  (15). 
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Abstract — A  new  Volterra  integral  equation  of  the  second  kind 
with  square  integrable  kernel  is  derived  for  paraxial  propagation 
of  radiowaves  over  a  gently  varying,  perfectly  conducting  rough 
surface.  The  integral  equation  is  solved  exactly  in  terms  of  a 
infinite  series  and  the  necessary  and  sufficient  conditions  for  the 
solution  to  exist  and  converge  are  established.  Super  exponential 
convergence  of  the  Neumann  series  for  arbitrary  surface  slope  is 
established  through  asymptotic  analysis.  Expressions  are  derived 
for  the  determination  of  the  number  of  terms  needed  to  achieve 
a  given  accuracy,  the  latter  depending  on  the  parameters  of  the 
rough  surface,  the  frequency  of  operation  and  the  maximum 
range.  Numerical  results  with  truncated  series  are  compared  with 
that  obtained  by  solving  the  integral  equation  numerically  for  a 
sinusoidal  surface,  Gaussian  hill,  and  a  random  rough  surface 
with  Pierson-Moskowitz  spectrum. 

Index  Terms — Irregular  terrain,  parabolic  equation,  rough  sea, 
rough  surface,  small  slopes,  Volterra  integral  equation. 


I.  Introduction 

WAVE  propagation  over  a  rough  surface  is  a  classical 
problem  and  is  important  in  a  number  of  areas  including 
radar  detection  [1],  [2],  remote  sensing  [3],  [4],  wireless  com¬ 
munications  [5],  [6],  underwater  acoustics  [7],  and  optics  [8], 
[9].  By  rough  surface  we  mean  either  a  deterministic  surface  as 
in  the  case  of  an  irregular  terrain  or  a  statistical  one  as  in  the  case 
of  a  sea  surface.  Various  methods  such  as  physical  optics  (also 
known  as  the  Kirchhoff’s  approximation)  [10],  small  perturba¬ 
tion  [9],  integral  equation  [1 1]— [15],  modal  series  [16],  [17], 
partial  differential  equation  [18]-[20],  etc.  are  used  to  study 
scattering  and  propagation  of  waves  over  rough  surfaces,  with 
each  offering  its  own  niche  advantage  under  certain  situations. 

When  the  normal  distances  of  the  source  and  receiving  points 
relative  to  the  mean  surface  are  a  small  fraction  of  the  separation 
between  the  source  and  observation  points,  and  the  rough  sur¬ 
face  is  gently  varying  (meaning  that  its  slope  angles  are  small), 
propagation  is  primarily  governed  by  forward  traveling  waves 
which  make  small  angles  with  respect  to  the  mean  surface.  Such 
cases  are  encountered,  for  example,  in  ship-ship  radar/commu¬ 
nications  over  a  rough  sea  or  long  distance  communications 
over  irregular  terrain  with  ground-based  antennas.  In  such  a  case 
the  Helmholtz  equation,  which  the  electromagnetic  fields  sat¬ 
isfy,  may  be  replaced  with  the  parabolic  equation  [21],  wherein 

Manuscript  received  July  23,  2012;  revised  February  13,  2013;  accepted 
March  09,  2013.  Date  of  publication  March  26,  2013;  date  of  current  version 
July  01,  2013.  This  work  was  supported  by  the  Army  Research  Office  under 
Grant  ARO  W911NF-10-1-0305. 

The  author  is  with  the  Department  of  Electrical  and  Computer  Engi¬ 
neering,  University  of  Massachusetts,  Amherst,  MA  01003  USA  (e-mail: 
j  anaswamy@ecs.umass.edu) . 

Digital  Object  Identifier  10.1 109/TAP.20 13. 2254692 


paraxial  waves  travel  in  a  unidirectional  direction  with  respect 
to  one  coordinate  (usually  range)  direction.  Parabolic  equation 
and  its  variants  has  been  successfully  used  in  many  propagation 
and  bistatic  scattering  problems  in  the  electromagnetics  [22], 
acoustics  [7],  and  optics  [7]  areas.  The  present  paper  is  con¬ 
cerned  with  determining  the  current  density  induced  on  a  rough 
surface  when  the  fields  in  a  semi-infinite  region  bounded  by 
the  rough  surface  satisfy  the  parabolic  equation  under  time-har¬ 
monic  excitation. 

Integral  equation  methods,  that  make  use  of  the  Green’s  func¬ 
tion  for  the  problem  at  hand,  are  attractive  owing  to  their  ability 
to  automatically  incorporate  the  boundary  condition  at  infinity 
with  the  added  advantage  that  unknowns  are  distributed  only  on 
the  boundary  of  the  region  of  interest.  In  our  case  the  boundary 
is  simply  the  rough  surface.  Because  the  parabolic  equation  has 
only  a  first-order  derivative  along  the  range  axis,  the  relevant 
integral  equation  will  be  of  Volterra  type  as  opposed  to  the 
Fredholm  type  [13]  for  the  Helmholtz  equation.  Previous  for¬ 
mulations  of  the  integral  equations  for  the  parabolic  equation 
[24]-[27]  or  for  low-grazing  angle  formulations  [28]  concen¬ 
trated  on  obtaining  the  solution  numerically  using  a  variety  of 
approaches.  That  the  Volterra  integral  equation  can  be  solved 
exactly  appears  to  have  escaped  the  attention  of  previous  re¬ 
searchers  and  it  is  the  purpose  of  the  present  paper  to  provide 
such  a  solution.  By  exact  we  mean  a  solution  that  does  not  in¬ 
volve  matrix  inversion,  in  the  same  sense  that  the  infinite  series 
solution  of  scattering  of  a  perfectly  conducting  sphere  is  con¬ 
sidered  exact. 

Using  the  Green’s  function  for  the  parabolic  equation,  we  first 
derive  a  new  Volterra  integral  equation  of  the  second  kind  in 
Section  II- A  for  the  induced  current  density  assuming  a  per¬ 
fectly  conducting  rough  surface  and  horizontal  polarization.  Ex¬ 
tension  to  other  surface  types  and  polarizations  can  be  carried 
out  in  a  similar  fashion.  The  kernel  of  the  integral  equation  as 
well  as  the  initial  fields  are  both  shown  to  belong  to  the  space 
of  square  integrable  functions  [29].  The  resulting  second-kind 
integral  equation  is  solved  in  Section  II-B  exactly  using  Pi¬ 
card’s  method  of  iteration,  resulting  in  an  infinite  series  with 
iterated  kernels.  The  necessary  and  sufficient  conditions  for  the 
series  to  converge  are  established.  An  expression  is  found  in 
Section  II-C  for  the  integrated  mean  square  error  bound  in  terms 
of  the  maximum  range,  the  frequency  of  operation  and  the  pa¬ 
rameters  of  the  rough  surface  when  the  infinite  series  is  trun¬ 
cated.  While  the  exact  series  solution  stands  on  its  own  merit, 
we  do  not  claim  that  it  will  result  in  a  numerically  efficient  so¬ 
lution  for  long  distance  propagation  without  further  optimiza¬ 
tion  of  the  various  algorithmic  steps.  However,  we  believe  that 
it  will  open  the  door  to  obtaining  various  analytical  approxi¬ 
mations  under  specialized  situations.  For  instance,  the  zeroth 
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Fig.  1 .  Perfectly  conducting  rough  surface  bounding  the  region  S. 


order  approximation  comprised  of  the  right-hand  side  of  the 
original  integral  equation  is  shown  in  Section  II-D  to  be  accu¬ 
rate  when  the  slope  angles  and/or  the  range  parameters  are  suffi¬ 
ciently  small.  Numerical  results  for  the  current  density  and  prop¬ 
agation  factor  obtained  with  a  truncated  series  are  compared  in 
Section  III  with  those  obtained  on  solving  the  integral  equation 
numerically  for  a  surfaces  with  both  small  and  large  slope  an¬ 
gles  (but  still  small  enough  so  that  parabolic  approximation  still 
holds).  Finally,  conclusions  and  future  directions  are  presented 
in  Section  IV.  The  deterministic  results  presented  in  the  paper 
will  form  the  starting  point  for  the  treatment  of  a  random  rough 
surface.  Still,  the  results  should  have  a  value  of  their  own  right  in 
areas  such  as  wireless  communication,  where  one  is  concerned 
with  the  propagation  of  radiowaves  over  a  deterministic  irreg¬ 
ular  terrain  [30],  [31],  [22]. 


integral  equation  for  the  unknown  surface  current  residing  on 
the  rough  surface  is  facilitated  by  the  availability  of  a  Green’s 
function.  The  Green’s  function,  Go,  in  free-space  for  the  PE 
satisfies  the  equation 


dG0 

dx 


i  d2G0 

2  ko  dz 2 


+  8{x  -  i)6(z  -  rj) 


(2) 


where  8(x)  is  the  unit  impulse  function  at  x  —  0.  This  linear  par¬ 
tial  differential  equation  with  constant  coefficients  can  be  solved 
by  employing  either  a  Fourier  transformation  with  respect  to  2 
[34]  or  a  Laplace  transformation  with  respect  to  x  and  carrying 
out  standard  manipulations.  The  solution  is 


G0(x,z;Z,ri) 


76(2: -£)  \.k0(z-r])2' 

— .  exp  % - - - — 

sjx-t,  2  (x  -  £)  _ 
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where  7  =  /,:0 /2m  and  0(;c)  is  the  unit  step  function.  For 
later  purposes  the  following  integral  representation  of  Go  will 
become  useful: 


G0(x,z-,£,ri)  = 


~  0  J  eikz(z-v) 


27 r 


dkz 


(4) 


II.  Theory 

We  consider  time-harmonic  propagation  of  two-dimensional 
radio  waves  over  a  1-D  rough  surface  (a  surface  varying  only 
in  one  direction).  For  simplicity,  the  surface  is  assumed  to  be 
perfectly  conducting,  although  a  similar  formulation  could  be 
carried  out  for  the  more  general  case  of  an  impedance  surface. 
Fig.  1  shows  the  geometry  of  the  problem  along  with  the  coordi¬ 
nate  system  assumed.  All  field  quantities  are  assumed  to  be  in¬ 
variant  of  the  y- axis  and  an  e~luJT  time  dependence  at  the  radian 
frequency  uj  =  2rrf  in  the  time  variable  r  is  assumed  and  sup¬ 
pressed  throughout.  The  fields  are  assumed  to  be  generated  by  a 
vertically  polarized  magnetic  source  placed  in  the  plane  x  —  0, 
resulting  in  a  TEZ  mode  with  nonzero  field  components  of  Ey , 
Hx ,  and  Hz ,  where  E  denotes  electric  field  and  H  denotes  mag¬ 
netic  field.  The  rough  surface  is  described  by  z  —  g(x)  and 
the  medium  above  it  is  assumed  to  be  vacuum  with  constitutive 
parameters  (eo,/io)-  Vacuum  is  treated  as  the  limiting  case  of 
a  lossy  medium  having  wavenumber  ko  —  w^/e o7^o(l  +  ie), 
e  >  0,  in  the  limit  of  e  — »  0. 

We  assume  that  the  slopes  of  the  rough  surface  are  small 
enough  so  that  back  scattering  can  be  ignored  and  that  waves 
travel  predominantly  in  the  paraxial  direction.  In  practice, 
waves  traveling  roughly  within  ±(15°  —  20°)  relative  to  the 
horizontal  axis  are  correctly  modeled  by  the  formulation  we  are 
considering.  The  reduced  field  U  =  e~lk°xEy  then  satisfies  the 
standard  parabolic  equation  (PE)  [32],  [33] 

dU  _  i  d2U 
dx  2  ko  dz 2 

together  with  the  initial  condition  U(x  =  0,  z)  =  Uo(z)  and  the 
boundary  condition  U(x,z  =  g(x))  =  0.  The  derivation  of  an 


The  Green’s  function  G0  satisfies  the  following  basic  properties: 

dG0  _  dGo  dG0  _  dG0 

dx  dt;  ’  dz  dy 

II  lim  | Go |=0,  lim  \dGo/dz\  H  0 

|z|— ►oo  |  z  |  — oo 

III  lim  Go(x,  z\  £,  rj)  =  8(z  —  y) 

IV  lim  =  “SiSn(^  “  v)\s(x  -  0 

z^>r)  zko  dz  2 

as  can  be  easily  verified  by  keeping  in  mind  that  ko  has  a  van¬ 
ishingly  small  positive  imaginary  part. 

A.  Volterra  Integral  Equation  of  the  Second  Kind 

Consider  a  region  S  bounded  by  Go  +  G  +  Cx  +  G^  as 
shown  in  Fig.  1.  The  contour  Go  is  defined  by  the  vertical  line 
x  —  0,  Cx  is  defined  by  the  line  x  —  x+ ,  C ^  is  defined  by  the 
horizontal  line  z  — ►  oo  and  G  corresponds  to  the  rough  surface. 
Integrating  the  null  quantity  {Go'[dU  /  d^  —  (i/2ko)d2U/drj2]-\- 
U  •  [0Go/0£  +  {i/2ko)d2Go/dr}2  +  6(x  -  £)6(z  -  rj)]}  over  S 
and  assuming  that  U  and  dU/dz  are  bounded  at  infinity,  it  can 
be  shown  by  making  use  of  the  properties  (I)-(IV)  of  the  Green’s 
function  that 


U(x,z)  =  J  Uo(rj)Go(x:  z\  0,  r\)  dr] 

9o 

x 

-  if  j  J(0Go[x,z;(,,g(0]dC  (5) 

0 

=:  Ui(x,  z)  +  Us(x,z)  (6) 
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where  g0  =  g(x  =  0)  and  J(£)  :=  (dU) / (dr))[£,  V  =  g(£)]  is 
referred  to  as  the  current  density. 1  The  first  integral  on  the  right- 
hand  side  of  (5)  constitutes  the  field  in  free-space,  Ui(x,  z ),  that 
arises  from  the  initial  field  Uo(rj),  and  the  second  term  corre¬ 
sponds  to  the  scattered  field,  Us(x,  z),  that  is  generated  by  the 
vertical  derivative,  dU /dz,  of  the  reduced  field  residing  on  C. 

An  integral  equation  of  the  first  kind  can  be  derived  as  in  [27] 
by  taking  the  limit  as  z  — >  g{pc)  along  a  vertical  line  and  making 
use  of  the  fact  that  U  (x,  g{x))  =  0.  However,  we  are  interested 
in  deriving  an  integral  equation  of  the  second  kind  so  that  an 
analytical  solution  in  terms  of  an  infinite  series  is  possible.  To 
this  end,  we  take  the  vertical  derivative  on  both  sides  of  (5)  and 
take  the  limit  as  z  — &  g(x)  on  a  vertical  line.  The  following 
limit  relation  is  encountered,  which  can  be  easily  derived  based 
on  property  (IV)  of  Go : 

1  BG 

lim  7T--^[a;,z;£,3(£)]  =  ~  t)  +  9d(x;Q 

z — >g(x)  IK o  OZ 

■G0[x,g(x)-,t,g(£)}  (7) 

where 

».(*;£):=  (8) 

The  function  gd(x\  £)  is  bounded  when  the  slopes  of  the  rough 
surface  are  finite.  Using  (7),  the  following  Volterra  integral 
equation  of  the  second  kind  in  the  unknown  J(x)  is  obtained 
from  (6): 

X 

J(x)~  7  /  “7=4^  A£)  =  Ji{x)  (9) 

0 

where 

K0(x;  0  :=  gd(x-,  ^)e*fcoC*-C)fl3C*;0/2  =  K*^.  x)  (i0) 
with  superscript  *  denoting  complex  conjugate  and 

oo 

Tf  S  „  [  TT  ,  ,dGo(x,g(x);0,ri) 

Ji(x)  :  =  -2  J  U0{rj) - — - dg  (11) 

9o 

oo 

=  2  J  ^-Go(x,g{x)-,0,g)dg  (12) 

9o 

is  the  incident  current  density  defined  entirely  in  terms  of  the 
initial  data.  The  latter  equality  in  (12)  assumes  that  the  initial 
data  is  differentiable.  Equation  (9)  was  used  in  [26]  and  [35]  and 
solved  numerically,  although  its  derivation  was  not  shown  there. 
The  auxiliary  kernel  K0(x;  £)  will  be  bounded  if  Lipschitz  con¬ 
ditions  are  imposed  on  the  function  g(x)  describing  the  rough 
surface.  This  will  be  clarified  in  Section  II-B.  Note  that  for  a  dif¬ 
ferentiable  rough  surface,  gd(x;  x)  =  gd(x;x~)  =  g\x)  and 
Ko(x;x)  =  g'(x).  A  Volterra  integral  equation  of  the  second 
kind  based  on  the  parabolic  approximation  and  different  from 
(9)  was  also  given  in  [24],  [25]  for  the  attenuation  function  over 

'it  may  be  noted  that  the  traditional  current  density  for  2-D  propaga¬ 
tion  defined  as  y  •  (n  x  H)  can  be  approximately  related  to  the  vertical 
derivative  for  surfaces  having  small  slopes  by  noting  that  y  (n  x  H)  = 
( i/u;no)n-VEy  =  (i/ojfi0)[dEy / dz  -  g'(x)dEy/dx\/y/l  +  ( g'(x ))2  g 
(i/ujfi0)dEy/dz/y/l  +  {g'{x))2  =  (i/u;vo)eiko:E  J(x)/y/l  +  (g'(x))2, 
where  g'(x)  is  the  derivative  of  g(x). 


a  lossy  irregular  terrain.  Most  previous  works  in  radiowave  and 
acoustic  propagation,  including  [26],  [27]  and  [25],  were  con¬ 
cerned  with  obtaining  a  numerical  solution  of  the  derived  inte¬ 
gral  equations.  Our  goal,  however,  is  to  obtain  a  direct  solution 
that  will  not  involve  matrix  inversions. 

The  kernel  of  the  integral  equation  in  (9)  has  a  weak  singu¬ 
larity  as  evidenced  by  the  presence  of  yjx  —  £  in  the  denomi¬ 
nator  of  the  integrand.  This  will  prevent  a  direct  application  of 
the  theory  for  £2(0,  X)  kernels  (i.e.,  square  integrable  over  a 
finite  range  x  =  X)  available  in  standard  references  such  as 
[36].  We  will  first  transform  it  to  another  integral  equation  with 
a  square  integrable  kernel  using  the  device  suggested  in  [36]. 
We  rewrite  (9)  as 

J(t)  dt  =  J(a;')  _  J.[x')  (13) 

vV  - 1 

t= 0 


multiply  both  sides  with  yKo(x;  xf)/y/x  —  x'  and  integrate 
over  x'  =  (0,  x).  The  two  integrals  on  the  left-hand  side  may 
be  interchanged  by  noting  that 


XX  XX 

I  dx’  j  dt  =  1  dt  dx  .  (14) 

x'=0  £— 0  £=0  x'=t 


Equation  (13)  is  again  utilized  on  the  right-hand  side  of  the  re¬ 
sulting  equation  to  finally  yield  the  following  Volterra  integral 
equation  of  the  second  kind  with  a  square  integrable  kernel  K\ : 


X 

J(x)  —  ry2J  Ki(x]t)J(t)  dt  =  j(°\x)  (15) 

t= 0 


where 


X 

j(°\x)  :  =  Ji(x)  +  7  f  Ji{x')^^==- dx' ,  (16) 

J  v  x  —  x ' 

x/=0 


and 


lTi(ar;*)  :  =  J 

x'=t 


iT0(x;a;/)jTo(a:/;^)  , 

y/{x-  xy^x’  -  tj 


(17) 


The  kernel  K\  is  actually  bounded  in  addition  to  being  in 
£2(0,  X)  space.  The  weak  singularity  in  the  integrand  of  (17) 
is  removable  as  can  be  seen  by  making  the  change  of  variable 
xf  =  x  sin2  0  +  t  cos2  0  to  result  in 


7t/2 

Ki(x\t)  =  2  J  Ko(x]xsm2  0  +  tcos2  0) 

0=0 

xKq(x  sin2  0  +  t  cos2  0;  t)  dO  (18) 


which  shows  that  K 1  is  bounded  if  K0(x;  x')  is  bounded.  Equa¬ 
tion  (18)  also  shows  that  Ki(x,  x)  =  7tKq(x;x)  =  i r[g'(x)]2. 
The  transformation  x’  —  x  sin2  0  in  (16)  yields  the  expression 

j(°\x)  =  Ji(x)  + 

7t/2 

x  J  Ji(x  sin2  0)Ko(x]  x  sin2  0)  sin  6  dO  (19) 
e= 0 
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which  reveals  that  j(°\x)  is  bounded  and  square  integrable  in 
(0,  X )  if  Ji(x)  is  bounded. 

B.  Exact  Current  Distribution 

Under  certain  conditions,  the  integral  equation  (15)  can  be 
readily  solved  by  the  Picard’s  method  of  successive  approxima¬ 
tion  to  result  in  an  infinite  series,  also  known  as  the  Neumann  se¬ 
ries  [36].  We  assume  at  the  outset  that  the  initial  data  is  such  that 
the  incident  current  density  Jfix)  is  bounded.  A  sufficient  con¬ 
dition  for  |  Ji(x)\  to  be  bounded  can  be  established  by  making 
use  of  (11)  and  (4).  Using  the  Fourier  representation  (4)  of  the 
Green’s  function  in  (11),  we  see  that 

go  —  oo 

(20) 


where  Uo(kz)  —  J ^  Uo(rj)  exp (—ikzrj)  drj  is  the  Fourier  trans¬ 
form  of  Uo(rj).  Therefore, 


7r\Ji(x)\<  /  \kzu0{kz)\dkz 


(21) 


The  integrand  of  the  right-hand  side  is  recognized  as  the  mod¬ 
ulus  of  the  Fourier  spectrum  of  dUo(r])/dg.  Thus,  (21)  implies 
that  a  sufficient  condition  for  Jfx)  to  be  bounded  is  the  ex¬ 
istence  of  the  first  derivative  of  Uo(rj)  in  the  entire  interval 
(go 5  oo).  However,  Jfix)  can  remain  finite  even  if  Uo(rj)  is  dis¬ 
continuous  at  finite  number  of  isolated  points.  This  is  certainly 
true  for  a  truncated  Gaussian  type  of  source  that  is  commonly 
used  in  propagation  studies  [18].  Indeed,  for  a  Gaussian  source 
of  amplitude  A,  centered  at  Ht  with  a  standard  deviation  az  and 
truncated  to  zero  below  g  =  g0 

Uo(v)  =  1=  e~(7)~gt)72g*,  T)  =  {g£,oo)  (22) 

v27 rcrz 

and  we  get 


Jl{x) 


MHt  -  g{x)]  1 2 

( a2  +  ix/ko)3/2  V  7r  * 


exp 


where 


(Ht  ~  g(x))2 

2  (a2  +  ix/ko) 


(23) 


/,  =  i-Ierfc(7,v?  +  ^) 


+ 

~  1, 


27a/7p3 


Uq  1 


(24) 

(25) 


with  uo  =  (Ht-g0)/az,'yg  =  ik0(Ht  -g(x))az/x,  (2  (3)  1  = 
(1  —  ikocrl/x)  and  erfc(  • )  denotes  complementary  error  func¬ 
tion  [37].  Hence,  Ji(x)  is  bounded  for  any  x  in  a  finite  range 
(0,  X)  even  though  )  /  0  and  U^{gf)  is  set  to  zero. 


We  next  assume  that  the  function  defining  the  rough  surface 
satisfies  the  Lipschitz’s  condition  [29]  on  (0,  A),  i.e.,  for  a  pos¬ 
itive  constant  ag 


\g(x)  -  ff(OI  <  ag\x  -  £1-  (26) 

Lipschitz  requirement  is  stronger  than  continuity,  but  weaker 
than  differentiability.  For  differentiable  functions,  ag  is  simply 
the  maximum  absolute  derivative,  but  the  Lipschitz  condition 
is  satisfied  also  by  non-differentiable  functions.  For  instance, 
a  continuous,  piecewise  linear  rough  surface  satisfies  the  Lip¬ 
schitz  condition  with  ag  =  max(absolute  slope).  Thus,  the 
function  in  (8)  satisfies  \gd(xm,€)\  <  ol9  and  the  kernel  in  (10) 
remains  bounded:  \Kq(x;£)\  <  ag.  As  already  pointed  out 
in  Section  II- A,  the  kernel  K i(x;t)  and  the  function  j(°\x) 
are  both  bounded  and  hence  belong  to  the  £2(0,  X)  space  if 
K0(x;  x')  and  Jfx)  are,  respectively,  bounded.  In  view  of  these 
results,  the  following  theorem  [36],  [38]  immediately  applies  to 
our  situation: 

Theorem  (Volterra  Integral  Equation  of  the  Second  Kind): 
The  Volterra  integral  equation  of  the  second  kind  (15),  where 
the  kernel  K\  (x\  t)  and  the  function  J (x)  belong  to  the  class 
£2(0,  X ),  has  a  unique  nontrivial  solution  in  £2(0,  X)  for  arbi¬ 
trary  7  G  C.  This  solution  is  given  by  the  formula 


j(x)  =  r°\x)  +  LL2n 

n=l 


/ 


Kn{x-,t)X°\t)dt 


(27) 


where  the  kernels  Kn(x ;  t)  satisfy  the  recurrence  relation 


Kn(x;  t)  —  J  K1(x-,£)Kn-1(£]t)d£,f°Tn>2.  (28) 

It  is  important  to  bear  in  mind  that  for  any 
n  =  1,  2, . . . ,  Kn(x;  t)  =  0  for  t  >  x.  Computation 
of  the  solution  from  (27)  requires  i)  determining  the  zeroth 
order  current  density  j(°\x)  from  (16),  ii)  determining  the 
kernels  Kn{x\t)  by  evaluating  the  integrals  (28),  and  iii) 
evaluating  the  integrals  on  the  right-hand  side  of  (27).  The 
amount  of  computational  labor  depends  on  the  number  of 
terms  used  in  the  series,  the  nature  of  the  rough  surface,  the 
maximum  range  X,  and  the  integration  scheme  employed. 

C.  Truncated  Series  and  Error  Estimates 

In  practice  one  would  like  to  truncate  the  series  in  (27)  to 
some  finite  upper  limit  to  aid  computation.  Our  main  goal  in  this 
subsection  is  to  investigate  the  rate  at  which  the  truncated  series 
solution  approaches  the  exact  solution  as  the  number  of  terms  is 
increased.  Using  asymptotic  theory  we  show  that  the  truncation 
limit  can  be  chosen  appropriately  so  that  the  error  with  respect  to 
the  exact  solution  can  be  made  as  small  as  desired  for  any  slope 
(of  course  within  the  constraints  imposed  by  the  validity  of  the 
parabolic  approximation).  We  also  derive  an  expression  for  the 
integrated  root  mean  square  error  as  a  function  of  the  physical 
parameters  of  the  problem  as  well  as  expressions  for  the  deter¬ 
mination  of  the  number  of  terms  needed  to  achieve  a  given  ac¬ 
curacy.  We  make  repeated  use  of  the  Schwartz  inequality  [29], 
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which  states  for  two  complex  valued  functions  fi(x)  and  f2(x) 
in  x  E  (a,  b)  that 


h{x)f2(x)dx 


< 


0  0 

J  |/i(U|2  dx  J \f2(x)\2dx.  (29) 


The  C2  norm  of  the  nth  iterate,  ||  j(n)||,  over  the  domain  x  E 
(0,  X)  is  defined  as 

x 

\\Xn\x)\\2  =  J  \J{n\x)\2  dx.  (30) 

0 

The  TVth  iterate  of  the  current  density  is  that  which  is  obtained 
by  truncating  the  upper  limit  in  the  right-hand  side  of  (27)  to  N : 


N 

XN\x)  =  X°\x)  +  Y/l2n  f  Kn(x-,t)X°\t) 

n—1  i 


dt 


N 

=  J(0\x)  +  ^2  [j(n){x)  -  J(”_1)(x)  (31) 

n—1 

where  the  incremental  contribution  of  the  nth  term  in  the  sum¬ 
mation  is 

n  X 

J(n\x)  -  J<-n-V{x)  =  FA  j  Kn(x;t)X°\t)dt  (32) 


on  recognizing  that  y2  =  —if  A,  where  A  is  the  free-space  wave¬ 
length.  For  N  sufficiently  large,  J^N\x)  will  be  close  to  the 
exact  solution  J (x)  =  j(°°)  (x) .  For  a  given  accuracy,  that  value 
of  N  depends  on  the  maximum  range  x  =  X,  the  nature  of  the 
rough  surface,  frequency  of  operation,  etc. 

We  will  first  provide  worst  case  estimates  for  the  error  in¬ 
curred  in  employing  the  TVth  iterate  by  performing  an  analysis 
along  the  lines  of  Tricomi  [36].  From  Sections  II- A  and  II-B  we 
can  conclude  that 


\K0(x;t)\  <  a5,and  (33) 

|tfi(s;*)|<7ra2.  (34) 


and 


x 

B2{t)=  j  IK^x-,^2  dx,  0  <t  <  X 

x=0 

X 

=  J  \Ki(x\t)\2  dx  <  (na2g)2  (X  -  t)  (37) 

X  =  t 

where  the  last  inequalities  in  (36)  and  (37)  follow  from  (33)  and 
(34)  respectively.  Using  these  it  is  easy  to  see  that 

x  x 

pCif  =  J  A2(x)dx=  J  B2(t)  dt  (38) 

.x=0  t= 0 

<  (ira2X)2  /2.  (39) 

From  the  upper  bound  in  (39)  one  can  conclude  that  \\Ki\\ 
increases  linearly  with  X  and  quadratically  with  ag.  It  is 
straightforward  to  show  that  all  the  higher  order  kernels  are 
also  bounded.  Schwartz  inequality  applied  to  (28)  yields  the 
inequalities 

mi  <  mi  •  \\Kn-i\\  =>  m\\  <  iiK|f ,  n  >  i. 

(40) 


However,  it  is  possible  to  get  tighter  bounds  on  the  norms  using 
the  procedure  outlined  in  [36]  so  that  the  convergence  of  the 
series  (27)  can  be  established  for  arbitrary  surface  slope  and 
maximum  range.  Now 


\K2{x-t)  r  = 


X 

j  di 


X 


x 


<  j  | XU;0l2<X  j 

£=0  £=o 

<  A2{x)B2{t). 


(41) 


It  is  also  clear  from  observing  the  phase  of  K0  in  (10)  that  the 
maximum  effective  wavenumber  of  oscillation  along  the  terrain 
is  kx  —  k^a2/2  and  the  corresponding  minimum  wavelength  of 
oscillation  is  A^  =  2x  jkx  —  2  A  /a2.  Hence,  if  the  maximum 
slope  angle  of  the  terrain  is  1 0° ,  the  minimum  wavelength  of  os¬ 
cillation  is  Xx  «  64  A.  The  squared  norm  of  the  kernel  Kn(x]  t ) 
is  defined  as 

x  £C 

|| Kn ||2  =  J  j  \Kn(x-t)\2dtdx.  (35) 

x=0  t= 0 

Let  us  designate 

x 

A2(x)=  J  IK^x-A)]2  dt,  0  <  x  <  X 

t= 0 
x 

=  J  \Ki(x]  t)\2  dt  <  (7ra2)2x  (36) 

t= o 


Similarly,  it  can  be  shown  that 

\Kn+2(x;t)\2  <  A2(x)B2(t)Fn(x;t),n  =  0, 1, . . .  (42) 

where  F0(x;t)  :=  1  and 

X 

Fn(x-t)=  J  A2(0Fn-1(Z-,t)dt,n  =  1,2, .  (43) 

£=t 


On  realizing  that  A2(x)  =  dFi{x\  t)/dx,  one  can  show  that 

F?(x-,t) 


Fn(x\t )  = 


n! 


(44) 


Now 


Fi 


x 


{x-t)=  I  A2{i)di<  J  A2(Od£=\\K1\\2.  (45) 


o 
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Using  (45)  and  (44)  in  (42),  we  arrive  at 
\Kn+2(x;t)\2  <  A2(x)B2(t ) 
which  implies  that  forn  >  2 


n  =  0, 1, . . . , 


||*n||  < 


11*1 1 


(46) 


(47) 


which  is  a  substantial  improvement  over  the  bounds  expressed 
by  (40).  Consider  the  local  mean  square  error  incurred  in  trun¬ 
cating  the  series  to  N  =  M  +  1  terms,  M  >  0: 


I2{x)  —  J(°°\x)  -  J(N\x) 


erfc(— ?y-\/M/2)  <  (ep/M)M  / y/ 2nM  log(M / ~ep) .  Inserting 
this  in  (52)  we  get 

e\N)  <  y  (£)",  M  >  ep,  M  »  1 

2y/wM  ln(M/ep)  \MJ 

(53) 

which  clearly  decays  to  zero  super-exponentially  as  M  — >  oo 
for  any  finite  p.  The  same  right-hand  side  as  in  (53)  is  obtained 
if  one  starts  from  (50)  and  makes  use  of  (m  +  M)l  >  ml  Ml 
and  the  lower  bound  for  Ml  (see  formula  (6.1.38)  of  [37]). 

Having  established  that  the  Neumann  series  converges  to  the 
exact  solution  for  any  slope  and  range,  it  is  of  interest  to  deter¬ 
mine  the  order  N  for  which  the  current  density  achieves  a  given 
accuracy.  To  this  end,  we  first  note  from  (31)  and  (32)  that 


v  'I 

n  X 

2 

jW 

2 

< 

J(  0) 

)  [  Kn(x-,t)jW(t)dt 

/  J 

t= 0 

X  X 

r  /“i  — 

|2 

< 

J(  0) 

N  X 

J(0)  2 +  J2  f  j{n\x)  - 

n=l  1 


n=N+l 

<  E  A  /  \Kn{x-t)\2  dt  f  Jw(t) 

- 1\T  II  '7  J 


n—N-\-l 


dt 


i  +  E 


\\KnT 

\2U 


Similarly, 


j(0) 

2  i  } 

E  m  /  \Kn(x;t)\2  dt.  (48) 

j(oo) 

2 

< 

j(°) 

2 

‘  ,  Vll^nll2' 

i  \2n 

«=iv+i  t£0 

n=  1 

Defining  p  =  (||iTi||/A)2,  the  relative  integrated  mean  square 
error  is 


\N)  = 


||J(°) 

V  — 

—  /  \  2  n 


i  *<■ 

=o 


x )  dx 


dx 


(54) 


(55) 


To  achieve  a  relative  accuracy  of  (1  —  6)  (or  a  relative  error  of 
6),  where  6  <C  1,  in  the  current  distribution,  we  set  ||  j(N^  ||2  = 
(1  -  <5)2||  j(°°)||2  «  (1  -  25)||  j(°°) || 2.  It  is  reasonable  to  use 
upper  limits  for  ||  j(N'\\  and  ||  as  given  by  (54)  and  (55) 

as  both  are  based  on  the  same  kind  of  approximations.  Hence, 
we  get 


X  * 


A2ri 

n=7V+1  a?=0  i=0 

K  II2 

1  v  n,\\ 


| Kn(x\ t)  |2  dt  dx 


E 

ra=JV+l 


I  Kn 


\2n 


- 26  ( i  +  E 


II  Kn 


a=l 


A2" 


(56) 


-  E 

n—N-\-l 

oo 

<  E 

n=N+l 


X2n 

1  ll*l||2W 

A2ra  (n  —  2)! 


=  p2  E  —=p2epP{M,p) 
ml 


m=M 


(49) 

(50) 

(51) 


The  upper  limit  in  both  summations  may  be  replaced  with  a 
large  integer  7Vmax  without  causing  too  much  error.  We  then 
get  a  form  more  suitable  for  numerical  computations  as 


TVmax  II  tv~  ||2  f  TV  ma> 

F(N,Nm,x):=  J2  K^-  =  ^[l+^ 


\\Kn 


n=N  + 1 

=:  G. 


\2n 


n=l 


A2r] 


(57) 


where  the  function  P(M,  p)  is  related  to  the  lower  incomplete 
gamma  function  7 (M,  p)  [37]  as  P(M,  p)  —  7 (M,  p)/r(M). 
It  is  clear  from  (51)  that  the  error  tends  to  zero  as  M  — >  00  for 
any  finite  p.  However,  to  gain  more  insight  into  the  convergence 
process  such  as  the  rate  of  decay  at  infinity,  it  is  necessary  to  ex¬ 
amine  how  the  error  behaves  for  large  M.  A  uniform  asymptotic 
form  of  the  function  P  for  large  M  is  available  in  [39]: 

P(M,  p)  ~  terfc (-ny/M/2),  M  >  1  (52) 

where  p2  —  2 (a  —  ln(ae)),  sign(r/)  =  sign(a  —  1)  and 
a  —  p/M.  For  M  p,  a  —>  0  and  p  ~  —  y/2  In (M/ep). 
Using  the  asymptotic  form  of  the  complementary  error  function, 
erfc (z)  ~  exp(— z2)/\Z2itz  for  large  \z\,  we  can  conclude  that 


When  the  current  density  is  accurately  represented  by  the  TVth 
iterate,  the  left-hand  side  of  (56)  may  be  approximated  by  the 
first  term  in  the  series  to  result  in  the  following  useful  formula 
for  determining  N : 

1 2 

«  G.  (58) 


For  a  given  rough  surface,  maximum  range,  and  frequency  of 
operation,  the  various  \\Kn\\  may  be  computed  and  N  deter¬ 
mined  from  (57)  or  (58)  to  achieve  a  specified  relative  error  6. 
From  (47)  and  (39),  it  is  clear  that  all  of  the  norms  can  increase 
linearly  with  maximum  range  and  quadratically  with  the  max¬ 
imum  absolute  slope  angle.  Hence,  the  number  of  terms  N  is 
expected  to  increase  with  the  maximum  absolute  slope  angle  of 
the  surface,  the  maximum  range  and  the  frequency  of  operation. 
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Conversely,  for  a  shallow  rough  surface,  or  small  ranges  or  low 
frequencies,  few  terms  in  the  series  should  be  adequate. 


D.  Accuracy  of  the  Zeroth- Order  Approximation 

The  zeroth  order  approximation  to  the  current  density, 
given  in  (16),  itself  may  be  adequate  when  the  range 
and/or  the  terrain  slopes  are  small  so  that  p  <C  1.  Note  that 
the  zeroth-order  approximation  is  dependent  on  the  initial 
field  Uo(z)  via  the  incident  current  density,  Jfx),  as  well  as 
on  the  properties  of  the  rough  surface.  Indeed,  it  is  itself  the 
first-order  iterate  of  the  original  integral  equation  (9).  This  is  in 
contrast  to  the  normal  physical  optics  approximation  [10],  [12] 
wherein  the  zeroth-order  term  primarily  involves  evaluation  of 
the  tangential  component  of  the  incident  magnetic  field  along 
the  rough  surface.  Using  the  upper  bound  for  \\Ki\\  from  (39) 
and  by  arbitrarily  setting  p  <  1  / 7r3,  one  may  conclude  that 
if  Ot2gX/\  <  y/2/  7 r5/2,  the  current  density  will  be  dominated 
by  the  zeroth-order  approximation.  In  other  words,  the  ze¬ 
roth-order  approximation  is  good  for  a  maximum  range  up  to 
about 


X  =  x 

0  a2g7T  5/2 


(59) 


which  varies  inversely  with  a2 .  If  the  slope  angle  is  doubled,  the 
corresponding  maximum  range  up  to  which  the  zeroth-order  ap¬ 
proximation  is  accurate  decreases  by  a  factor  of  four.  The  max¬ 
imum  range  is  also  seen  to  increase  linearly  with  wavelength  of 
operation.  All  else  being  equal,  a  decrease  in  frequency  of  oper¬ 
ation  by  a  factor  of  two  increases  the  maximum  range  by  a  factor 
of  two.  The  zeroth-order  approximation  should  consequently  be 
very  good  for  low  frequencies  and  small  slope  angles. 


III.  Numerical  Results  for  Truncated  Series 

The  exact  solution  for  the  current  density  J{x)  is  given  in  (27) 
with  the  iterated  kernels  defined  by  (28)  and  the  zeroth-order 
current  density  given  in  (16).  The  substitution  £  =  a;  sin2  6  + 
t  cos2  0  reveals  that  the  nth  iterated  kernel  Kn(x\  t)  is  a  smooth 
function  of  both  arguments  and  behaves  as  (x  —  t)n_1  near  the 
boundaries.  It  may  be  noted  that  the  purpose  of  the  paper  is  not 
to  offer  the  exact  solution  as  a  numerically  efficient  solution  for 
long  ranges  and  no  effort  was  spent  on  numerically  optimizing 
the  series  solution.  Notwithstanding  this,  the  numerical  compu¬ 
tation  of  the  various  kernels  can  be  carried  out  using  any  of  the 
standard  integration  routines.  As  remarked  in  Section  II-C,  the 
relative  error  in  the  truncated  series  for  a  given  TV  depends  on 
the  wavelength  A,  Lipschitz  constant  ag ,  the  maximum  range 
X.  We  compare  the  performance  of  the  approximate  solution 
(31)  with  that  obtained  by  solving  the  integral  (9)  numerically 
following  the  procedure  outlined  in  [26].  The  latter  solution  was 
obtained  with  a  range  discretization  of  Ax  and  we  label  it  as 
Jnum  in  the  plots.  We  also  compute  the  total  field  on  a  vertical 
line  at  x  —  X  using  (6)  and  plot  the  propagation  factor  PF  = 
\U(X,z)/Ui(X,z)\  =  |1  +  U9(X,z)/Ui(X,z) |  obtained  by 
using  both  the  numerical  solution  Jnum(x )  and  j(N)  (  x).  Two 
extreme  examples  are  considered  first,  one  having  a  relatively 
large  slope  angle  and  a  second  having  a  relatively  long  range. 
Even  though  the  Neumann  series  solution  converges  for  any 
slope  angle,  one  has  to  keep  in  mind  that  the  parabolic  equa¬ 
tion  approximation  itself  will  break  down  if  the  absolute  slope 


Fig.  2.  Upper  bound  to  the  RMS  error  versus  N  for  a  sinusoidal  rough  surface 
g(x )  =  App  sin.2 (tt x/L). 


angles  are  greater  than  roughly  7.5°  or  so.  We  also  show  results 
for  propagation  of  low-grazing  angles  waves  over  one  realiza¬ 
tion  of  random  sea  surface,  whose  roughness  spectrum  is  mod¬ 
eled  by  the  Pierson-Moskowitz  spectrum  [40]. 

The  first  example  we  consider  is  a  rough  surface  character¬ 
ized  by  g(x)  =  App  sin2  (ttx/L).  The  slope  of  this  surface  is 
(AppTr /L)  sin(27 xx/L)  yielding  ag  =  tt App/L.  We  use  App  = 
1  m,  L  =  30  m  to  result  in  ag  =  0.1051.  The  maximum  abso¬ 
lute  slope  angle  with  these  parameters  is  6° .  A  Gaussian  source 
of  the  form  (22)  with  oz  —  4A/3,  Ht  =  5  m  and  operating 
at  a  frequency  /  =  1  GHz  (A  =  0.3  m)  was  used  for  the  ini¬ 
tial  source  and  the  current  density  was  calculated  until  a  range 
X  =  300  m.  For  these  parameters,  ||iCi||/A  tt  3.56,  p  tt  12.7, 
and  X0  tt  2.2  m.  The  numerical  solution  Jnum(x)  was  obtained 
using  Ax  =  0.5  m  =  5A/3.  Recall  from  Section  II-C  that 
the  minimum  effective  wavelength  along  the  surface  is  A^  = 
2A /a2  tt  181 A  here.  Hence,  the  step  size  of  Ax  =  5 A/3  is  a 
small  fraction  of  this  minimum  wavelength  and  should  be  more 
than  adequate  to  sample  the  current  density  along  the  surface. 
Fig.  2  shows  the  upper  bound  to  the  root  mean  square  (RMS) 
error  e(TV)  as  given  by  (49),  versus  N.  The  RMS  error  com¬ 
puted  directly  by  using  the  various  iterates  of  the  current  density 


,(»)= 


N 


Jo  —  J(Nma-x\x) |2  dx 


So  |J(°)(x)| 2  dx 


(60) 


is  also  shown  in  the  figure  for  _/Vmax  =  30,  where  J(Nm^Hx) 
may  be  roughly  regarded  as  the  exact  current  distribution. 
Both  curves  are  seen  to  have  nearly  the  same  asymptotic 
slope  and  suggest  that  with  N  tt  5-8  terms,  the  relative  error 
will  be  less  than  10-2.  Fig.  3  shows  the  curves  F(TV,  TVmax) 
and  F(TV,  TV  +  1)  in  (57)  and  (58),  respectively,  versus  N 
and  their  intersection  with  the  quantity  G  for  an  accuracy  of 
(1  —  S)  =  99.99%.  It  is  seen  that  TV  tt  5  in  agreement  with 
the  estimate  obtained  from  Fig.  2.  Fig.  4  shows  the  magnitude 
of  current  density  j(N\x)  for  TV  =  0,  TV  =  5  together  with 
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Fig.  3.  Curves  for  the  determination  of  number  of  terms  needed  for  a  specified 
accuracy  for  a  sinusoidal  rough  surface  g(x)  —  App  sin2  (7 tx/L). 


Fig.  4.  Modulus  of  current  density  on  a  sinusoidal  rough  surface 

g(x)  =  App  s'm2(ivx/L). 

Jnum(x).  Clearly,  the  zeroth-order  approximation  is  inade¬ 
quate  for  these  parameters  and  the  TV  =  5  solution  remains 
very  close  to  Jnu m(x).  Fig.  5  shows  that  the  propagation  factor 
calculated  with  j(5\x)  agrees  very  well  with  that  obtained 
with  </num(^)* 

Equation  (57)  predicts  that  for  a  given  relative  accuracy,  fre¬ 
quency  of  operation  and  maximum  slope,  the  number  of  terms 
increases  with  the  maximum  range  X.  The  increase  with  X  is, 
however,  not  linear.  We  have  confirmed  this  through  numerical 
computations.  For  instance,  for  a  sinusoidal  surface  with  a  max¬ 
imum  slope  angle  of  6°  and  L  —  3  m,  we  observed  that  TV  =  1 
terms  as  calculated  from  (57)  gave  accurate  results  for  the  cur¬ 
rent  distribution  when  X  —  30  m,  whereas  N  —  2  terms  were 
required  for  X  =  300  m  to  achieve  the  same  relative  accuracy. 


Fig.  5.  Propagation  factor  at  X  =  300  m  for  the  sinusoidal  rough  surface 

g(x)  —  App  sin2 (nx/L). 


Fig.  6.  Modulus  of  current  density  on  a  Gaussian  hill  g{  x)  —  App exp(—  (x  — 
L)/cr‘i). 

The  second  example  we  choose  is  that  of  propagation  over 
a  Gaussian  hill  defined  by  g(x)  —  Appexp(  —  (x  —  L)2/cr^). 
The  maximum  absolute  slope  of  the  Gaussian  hill  appears  at 
x  —  L  ±  ox  and  takes  the  value  \feAppjox  —  ag.  We  choose 
App  =  5  m,  L  =  1 .5  km,  ox  —  0.5  km.  The  source  parameters 
were  the  same  as  in  the  previous  example  except  that  Ht  —  2  m. 
For  these  parameters,  ag  =  6.0653  x  10-3,  ||iTi||/A  «  0.2952, 
p  «  0.087,  and  Xq  «  660  m.  The  maximum  absolute  slope 
angle  in  this  case  equals  0.35° .  The  numerical  solution  was  com¬ 
puted  with  Ax  —  6  m.  The  modulus  of  the  current  density  is 
shown  in  Fig.  6  for  TV  =  0  and  TV  =  1  along  with  the  numer¬ 
ical  solution.  The  TV  =  2  solution,  not  shown  here,  was  virtu¬ 
ally  indistinguishable  from  the  numerical  solution  over  the  four 
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Fig.  7.  Propagation  factor  at  X  =  3  km  for  a  Gaussian  hill  g(x)  = 
App  exp(  — -  L)/a2x). 


orders  of  magnitude  shown  in  Fig.  6.  It  is  also  seen  that  the  ze- 
roth-order  solution  is  indistinguishable  from  the  numerical  so¬ 
lution  for  ranges  up  to  about  700  m,  which  roughly  agrees  with 
the  estimate  of  X0  =  660  m  from  (59).  The  first-order  solu¬ 
tion  is  virtually  indistinguishable  from  the  numerical  solution 
over  three  orders  of  magnitude  occurring  for  ranges  up  to  about 
1.6  km,  that  lies  beyond  the  peak  of  the  Gaussian  hill.  The  dis¬ 
agreement  between  the  N  =  1  series  solution  and  the  numerical 
solution  is  apparent  only  for  small  values  of  the  current  den¬ 
sity.  Even  then,  the  propagation  factor  calculated  with  J^\x) 
as  shown  in  Fig.  7  agrees  very  well  with  that  obtained  with  the 
numerical  solution. 

We  next  consider  the  propagation  of  low-grazing  angle  waves 
over  one  realization  of  a  fully-developed  random  sea  surface. 
The  surface  is  assumed  to  be  zero  mean  and  having  Gaussian 
height  statistics.  As  in  [41],  we  model  the  roughness  spectrum 
of  the  sea  surface  by  the  Pierson-Moskowitz  (PM)  spectrum, 
which  is  completely  determined  by  the  wind  speed  U  flowing 
at  a  height  of  1 9.5  m  above  the  mean  surface.  The  power  spectral 
density  W (ft)  for  the  PM  spectrum  as  a  function  of  the  surface 
wavenumber  ft  is  given  by 

w («)  =  (61) 

where  ftp  =  3  g/U 2  is  the  wave  number  at  which  the 

spectrum  has  a  peak  and  a  =  8.1  x  10_3,/3  =  0.74,  g  =  9.81 
m/sec2.  The  PM  model  provides  a  useful  test  of  surface  scat¬ 
tering  theory  with  a  range  of  roughness  scales.  Some  useful  pa¬ 
rameters  can  be  derived  for  the  spectrum  given  in  (61):  the  RMS 
surface  height  deviation,  ah  =  vW a/6/%  and  the  RMS  corre¬ 
lation  length  of  the  surface  pc  =  b/2y/2np.  If  the  upper  spatial 
wavenumber  is  truncated  to  ftc,  then  the  RMS  slope  of  the  sur¬ 
face  crs i  =  y/aEi(yc) /2,  where  yc  =  3ft2 /2ft2  and  Ei(-)  is 
the  exponential  integral  [37].  We  generate  a  rough  surface  using 
the  spectral  approach  as  outlined  in  [40],  [42]  for  U  =  10  m/s 
and  ftc  =  51  ftp  using  a  512-point  FFT.  For  this  wind  speed, 


Fig.  8.  Pierson-Moskowitz  sea  surface  for  a  wind  speed  of  U  —  10  m/s. 


Fig.  9.  Modulus  of  current  density  on  a  Pierson-Moskowitz  rough  surface. 

ah  =  0.533  m,  pc  =  25.7  m.  We  generate  a  surface  having 
an  overall  length  of  X  —  455  m,  so  that  X/pc  &  17.7.  For 
the  upper  cutoff  wavenumber  chosen,  crsl  =  0.118,  while  the 
maximum  absolute  slope  of  the  surface  is  ag  =  0.139,  cor¬ 
responding  to  a  slope  angle  of  7.9°.  The  generated  surface  is 
shown  in  Fig.  8.  We  compute  the  zeroth-order  current  density 
induced  on  this  surface  at  a  frequency  of  1  GHz  for  the  Gaussian 
source  at  a  height  of  Ht  =  2  m  by  (16)  and  compare  it  to  the 
one  generated  numerically  from  solving  (9).  Fig.  9  shows  the 
comparison  along  with  the  other  parameters  used.  It  is  seen  that 
while  the  zeroth-order  approximation  does  not  agree  perfectly 
with  the  numerically  generated  one,  it  does  follow  the  trends  in 
various  excursions  rather  accurately.  Fig.  10  shows  a  compar¬ 
ison  of  the  corresponding  propagation  factors  at  the  maximum 
range  of  455  m.  Very  good  agreement  between  the  two  is  ob¬ 
served,  despite  the  slight  disagreement  in  the  current  distribu¬ 
tion.  It  may  be  worth  noting  that  the  accuracy  for  the  current 
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Fig.  10.  Propagation  factor  at  X  =  455  m  for  a  Pierson-Moskowitz  sea 
surface. 


TABLE  I 

COMPUTATIONAL  TIME  (SEC)  IN  MATLAB 


Current  Density 

Fig.  4 

Fig.  6 

0.1 

0.2 

JW 

101 

48 

7num 

73 

50 

distribution  greatly  improved  by  the  use  of  the  first-order  iterate 
J^\x)  (not  shown  in  the  figures). 

It  is  of  interest  to  look  at  the  computational  times  incurred 
in  computing  various  approximations  of  the  current  density. 
Table  I  shows  the  CPU  times  involved  in  computing  j(°) ,  J^N\ 
and  Jnum  using  MATLAB.  We  have  made  no  attempt  to  opti¬ 
mize  the  various  algorithmic  steps  involved  in  computing  the 
current  density  by  the  Neumann  series.  The  times  shown  for 
j(N)  includes  those  spent  in  computing  all  of  the  previous  or¬ 
ders  jW,  i  —  1, _ ,  N  —  1.  Obviously,  the  time  required  to 

compute  J is  a  very  small  fraction  of  that  required  to  com¬ 
pute  Jnum?  because  the  former  involves  the  computation  of  one 
integral.  A  good  part  of  the  time  incurred  in  computing  jW 
goes  towards  computing  the  kernel  K\  (x;  t)  in  (17).  Recall  that 
N  =  5  in  Fig.  4,  while  N  =  1  in  Fig.  6.  It  is  clear  that  the  Neu¬ 
mann  series  solution  will  be  very  competitive  in  cases  where 
only  a  few  orders  are  adequate  to  accurately  represent  the  cur¬ 
rent  density.  This,  in  turn,  is  dictated  by  the  maximum  slope  of 
the  surface  and  the  maximum  range  involved. 

IV.  Conclusion 

A  new  Volterra  integral  equation  of  the  second  kind,  (15),  was 
derived  for  2-D  wave  propagation  over  a  perfectly  conducting 
rough  surface  and  an  exact  expression,  (27),  was  presented  for 
the  current  density.  The  necessary  and  sufficient  conditions  for 
the  exact  series  solution  to  converge  were  established:  the  rough 
surface  should  satisfy  the  uniform  Lipschitz  condition,  (26),  and 
the  field  at  zero  range  should  have  finite  first  derivative  with  re¬ 
spect  to  height,  (21).  Because  the  formulation  was  based  on  the 


parabolic  approximation  to  the  Helmholtz  equation,  the  exact 
solution  presented  is  valid  for  low-grazing  angle  waves  propa¬ 
gating  over  rough  surfaces  having  gentle  slopes  when  backscat- 
tering  can  be  ignored.  In  practice,  the  solution  should  be  valid 
for  surfaces  with  absolute  slope  angles  <  10°.  For  a  specified 
accuracy  6,  ( 57)  or  (58)  may  be  used  to  determine  the  number  of 
terms  needed  in  Neumann  series  representation.  The  number  of 
terms  used  in  the  series  is  expected  to  increase  with  increasing 
range,  increasing  frequency  of  operation,  and  increasing  slope 
angles.  In  order  to  keep  the  number  of  terms  needed  in  the  series 
to  low  values,  the  range  should  be  restricted.  However,  this  is 
not  a  serious  limitation  of  the  method.  For,  if  propagation  pre¬ 
diction  is  desired  over  long  ranges,  one  can  always  employ  the 
multiple-section  strategy  explored  in  [26],  wherein  the  field  cal¬ 
culated  on  a  vertical  line  at  the  end  of  one  short  section  serves 
as  the  initial  field  for  the  next  section.  An  advantage  of  the  se¬ 
ries  solution  is  that  it  provide  complete  error  control,  in  that  the 
number  of  terms  can  be  chosen  appropriately  to  achieve  a  cer¬ 
tain  relative  error  for  the  current  distribution. 

To  make  the  series  solution  a  viable  and  efficient  numerical 
approach  for  studying  wave  propagation  over  rough  surfaces, 
several  algorithmic  steps  considered  in  the  paper  must  be  op¬ 
timized.  However,  it  is  believed  that  the  theory  presented  in 
the  paper  will  lay  the  groundwork  for  obtaining  approximate 
analytical  solutions  in  a  variety  of  situations.  For  instance,  in 
low-grazing  angle  propagation  over  a  sea  surface,  one  is  in¬ 
terested  in  the  mean  field  at  certain  distance  from  the  trans¬ 
mitter  [1],  [35],  and  [43].  This  problem  is  also  of  interest  to 
underwater  acoustic  propagation  [27].  The  importance  of  shad¬ 
owing  in  low-grazing  angle  propagation  has  long  been  recog¬ 
nized,  but  is  still  an  unresolved  issue  [44].  The  current  method 
incorporates  all  orders  of  shadowing  interaction  subject  to  the 
forward  propagation  approximation.  The  zeroth-order  approxi¬ 
mation,  (16),  could  be  used  in  (5),  as  we  have  done  in  Fig.  9, 
and  the  expectation  performed  with  respect  to  the  randomness 
of  the  sea  surface  to  possibly  yield  an  analytical  solution  for  the 
total  mean  field  when  the  maximum  range  encompasses  several 
correlation  lengths  of  the  random  surface.  The  first  term  by  it¬ 
self,  J{  (x),  in  the  zeroth-order  approximation  will  yield  the  well 
known  Ament  roughness  reduction  factor  [10]  for  determining 
the  mean  field.  This  term  will  only  incorporate  the  variance  and 
mean  of  the  rough  surface.  Correlation  function  of  the  rough 
surface  will  enter  through  the  second  term  of  j(°)  ( x )  as  well  as 
through  the  higher  order  terms  in  the  Neumann  series.  It  is  hoped 
that  availability  of  such  analytical  expressions  for  the  mean  field 
will  be  useful  in  propagation  modeling  for  radar  detection  [45] 
as  well  as  wireless  communications  [42].  This  will  be  explored 
in  the  future.  Extension  of  the  theory  to  surfaces  modeled  by 
the  impedance  boundary  condition  and  to  3-D  propagation  over 
2-D  rough  surfaces  are  worth  exploring  and  these  will  be  also 
be  considered  in  the  future. 
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Abstract — Sparse  grid  collocation  methods  are  used  for  uncertainty 
quantification  in  electromagnetic  propagation  problems.  Two  ap¬ 
plications  are  considered.  The  first  application  involves  waves 
propagating  in  dielectric  media  with  uncertain  permittivities  and 
permeabilities,  in  which  several  cases  with  increasing  random- 
space  dimensionality  are  exemplified.  The  objective  in  the  second 
application  is  to  compute  expected  signal  strength  above  flat  Earth 
surface  at  ranges  far  from  transmitter  location,  where  randomness 
is  present  due  to  uncertain  refractive  index  of  the  atmosphere. 
The  uncertainty  is  extracted  from  published  measurements  and 
constitutes  for  long-term  variation.  Two  different  sparse  grid 
algorithms  are  demonstrated  throughout  the  paper,  and  the  deter¬ 
ministic  evaluators  are  accessed  as  a  black  box  by  the  sparse  grid 
algorithms.  Through  the  results  considered,  strengths  of  the  two 
algorithms  are  differentiated  depending  on  the  characteristics  of 
the  randomness. 

Index  Terms — Radiowave  propagation,  Random  Media,  Inhomoge¬ 
neous  Atmosphere,  Parabolic  Equation  Method,  Split-Step  Fourier 
Propagator,  Uncertainty  Quantification,  Sparse  Grid  Collocation. 


I.  Introduction 

Expectation,  or  the  mean-value  integration,  is  the  most  fun¬ 
damental  operator  to  apply  in  a  statistical  problem,  where 
any  higher  moment  calculation  basically  involves  the  mean- 
value  integration.  Research  topics  in  electromagnetics  with 
such  interest  include  but  not  limited  to  propagation  in  random 
media  [1],  [2],  [3],  statistical  variability  of  components  [4]— [6], 
electromagnetic  field  interaction  in  biological  tissues  [7],  [8] 
and  random  walk  models  of  waves  [9]— [1 1] . 

The  source  of  uncertainties  in  electromagnetics  may  be  due 
to  random  radiating  sources  (excitation),  random  boundaries 
or  random  domain  parameters.  The  uncertainties  are  in  the 
most  general  sense  represented  as  random  processes,  in  which 
case  pre-processing  of  the  given  randomness  may  be  required. 
For  instance  one  may  decompose  a  given  random  process  to 
finite  number  of  random  variables  (RV)  through  Karhunen- 
Loeve  transform  [12].  This  decomposition  is  not  necessary  for 
problems  involving  finite  number  of  independent  RVs,  which 
will  also  be  the  case  throughout  this  study. 

The  most  common  sampling  method  to  perform  mean  value 
integrations  is  the  Monte-Carlo  (MC)  sampling.  MC  sampling 
has  a  convergence  rate  of  0(1/ y/Q)  [13],  where  Q  is  the  sample 
size  (number  of  realizations).  One  should  keep  in  mind  the  nice 


feature  of  MC  sampling  that  the  convergence  rate  is  independent 
of  dimensionality  (d),  i.e.  one  would  get  the  same  convergence 
rate  however  big  d  is.  Nevertheless,  this  is  a  rather  slow  rate 
and  there  has  always  been  interest  for  improvement.  Several 
alternatives  to  MC  sampling  have  been  developed  by  researchers 
until  last  decade,  and  these  techniques  are  often  referred  to 
as  “variance  reduction  techniques”.  These  include  Importance 
Sampling  [14],  Latin  Hypercube  Sampling  (LHS)  [15],  [16] 
and  Markov  Chain  Monte  Carlo  (MCMC)  [17].  Another  series 
of  techniques  based  on  sampling  of  low-discrepancy  sequences 
are  the  Quasi  Monte  Carlo  (QMC)  methods  that  were  shown 
to  achieve  up  to  0(Q~1)  convergence  depending  on  d  and 
variations  in  random  space  [18].  All  of  the  above  techniques 
offer  size  reductions  of  up  to  an  order,  but  may  become  worse 
than  MC  sampling  for  problems  with  very  high  dimensionality, 
often  termed  as  “the  curse  of  dimensionality”.  In  this  work, 
among  the  sequences  available  for  QMC  methods  we  will 
demonstrate  results  only  with  the  Sobol  [19]  and  Halton  [20] 
sequences. 

A  more  recent  development  was  achieved  by  Xiu  [21]-[23], 
where  they  generalized  Wiener’s  homogeneous  chaos  of  Gaus¬ 
sian  processes  [24]  to  arbitrary  processes  each  with  a  choice 
of  orthogonal  basis.  This  is  termed  generalized  polynomial 
chaos  (gPC)  technique.  In  this  technique,  the  inputs  and  outputs 
of  the  model  problem  with  randomness  are  projected  onto  a 
complete  space  spanned  by  the  basis  of  orthogonal  polynomi¬ 
als.  A  Galerkin  projection  carried  out  in  the  spanned  space 
transforms  the  stochastic  problem  into  a  system  of  coupled 
differential  equations  with  deterministic  unknowns.  Such  a  weak 
formulation  was  termed  Stochastic  Galerkin  (SG),  and  any  finite 
moment  of  the  originally  desired  random  output  (target)  can  be 
computed  from  the  coupled  system  without  any  sampling,  un¬ 
less  the  original  stochastic  system  have  highly  non-linear  terms 
that  do  not  allow  closed  form  expressions  of  the  target  function’s 
moments.  The  dependence  on  RVs  are  highly  nonlinear  for 
great  majority  of  the  numerical  solutions  in  electromagnetics, 
therefore  sampling  based  methods  are  inevitable.  In  this  regard, 
the  sparse  grid  collocation  (SGC)  method  avoids  coupled  nature 
of  SG,  where  the  mean  value  integration  (or  any  higher  moment 
computation)  is  performed  via  independent  calls  of  the  function 
on  a  set  of  cubature  points  (sparse  grid  nodes).  The  sparse 
grid  formation  is  independent  of  the  target  function,  viz.,  the 
function  under  uncertainty  for  which  we  seek  the  moments  in 
a  random  domain. 

In  cases  where  the  target  function  is  highly  non-smooth,  e.g. 
when  the  field  is  highly  sensitive  to  certain  RVs,  SGC  does  not 
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offer  superiority  over  conventional  MC  methods,  and  adaptive 
algorithms  for  sparse  grid  construction  in  SGC  become  attrac¬ 
tive.  The  fast  convergence  of  SGC  in  interpolation  of  the  target 
function  depends  on  the  smoothness,  and  it  is  not  unreasonable 
to  assume  that  the  target  function  under  uncertainty  meets  the 
smoothness  condition  of  Smolyak  algorithm,  derived  in  [25]. 
It  is  thus  crucial  to  refine  the  sparse  grid  around  regions  of 
non-smooth  target  function  output,  and  sample  less  the  smooth 
regions  of  the  random  domain.  From  a  mathematical  point  of 
view  non-smoothness  may  appear  as  discontinuities  or  regions 
of  the  random  domain  where  there  is  rapid  fluctuation  in  the 
target  function  output. 

In  cases  of  high  dimensional  problems,  (d  1),  even  the  adap¬ 
tive  sparse  grids  suffer  the  curse  of  dimensionality.  The  high 
dimensional  model  representations  (HDMR)  [26],  [27]  provide 
an  exact  representation  for  high  dimensional  functions  in  terms 
of  lower  dimensional  sub-functions,  which  we  will  refer  to  as 
“components”.  Each  component  in  the  HDMR  represents  col¬ 
lective  contribution  of  the  RVs  it  includes  on  the  target  function 
interpolation,  thus  allows  measure  of  to  what  extent  each  RV,  or 
combination  of  RVs,  dominate  the  target  function  behavior.  Use 
of  HDMR  for  dimensionality  reduction  has  recently  attracted 
attention  of  various  authors  [28],  [29],  [30].  Although  the 
published  literature  reveals  acceptable  convergence  rates  for  up 
to  500  dimensions  in  some  partial  differential  equations  with 
random  input  data,  it  is  a  question  if  electromagnetic  propa¬ 
gation  and  scattering  will  be  subject  to  such  an  enhancement 
over  existing  performance  with  sparse  grids.  The  authors  in  [31] 
have  applied  this  technique  for  electromagnetic  compatibility 
and  interference  (EMC/EMI)  analysis,  and  obtained  desired 
characterization  at  240  dimensions.  Ma  and  Zabaras  [29]  have 
merged  their  adaptive  sparse  grid  method  with  HDMR,  and 
given  a  thorough  interface  algorithm  between  HDMR  and  their 
method.  We  introduce  some  modifications  to  their  interface 
algorithm,  and  make  use  of  it  in  our  problems,  which  will 
be  referred  to  as  HDMR+ASGC.  Lately,  Jakeman  and  Roberts 
introduced  another  improved  scheme,  h— GSG,  which  can  also 
be  attractive  for  certain  applications  [32].  Throughout  this  work, 
we  will  use  HDMR+ASGC  and  h— GSG  methods,  and  assess 
their  performance  compared  to  the  conventional  MC  sampling 
and  QMC  methods. 

Regarding  the  use  of  sparse  grids  for  propagation  problems  with 
uncertainty,  there  are  several  applications  to  be  addressed,  which 
have  conventionally  been  tackled  with  MC  sampling.  However, 
given  the  fact  that  the  performance  of  these  methods  are  limited 
for  non- smooth  behavior  and  for  high— d,  we  are  interested  in 
tackling  problems  of  where  the  dimensionality  can  controllably 
be  increased,  and  the  smoothness  of  the  target  function  can  favor 
adaptive  methods  via  rendering  certain  RVs  more  important 
than  the  rest  of  the  RVs.  In  this  respect,  we  choose  to  begin 
with  a  simple  1-D  (in  space)  scattering  application,  yet  the 
target  function  behavior  in  the  random  space  can  become  highly 
non-smooth.  Through  such  an  example  we  intend  to  compare 
the  state-of-the-art  SGC  methods  in  their  performance  in  EM 
scattering  and  propagation  with  uncertainty  in  intrinsic  domain 
parameters,  where  we  have  the  flexibility  to  assume  as  high 
d  as  desired,  and  assume  each  RV  having  as  large  support  as 
desired. 

The  focus  of  our  motivation  with  SGC  methods  extend  to  their 


application  in  long-range  tropospheric  propagation  phenomena 
with  narrow-angle  parabolic  equation  (PE)  solvers  [33].  Inho¬ 
mogeneous  atmospheric  refractive  index  has  been  investigated 
thoroughly  for  decades,  where  conventional  analytical  models 
exist  based  on  measurements  [34]-[37].  Although  the  refractive 
index  in  the  most  general  sense  varies  as  a  function  of  all 
dimensions  in  real-time  due  to  atmospheric  pressure,  water- 
vapor  pressure  and  temperature  variations  [38],  [39],  in  PE 
research  spatial  variation  only  along  the  elevation  direction  out 
from  Earth  surface  is  given  a  significant  role.  This  variation 
usually  results  in  ducting  layers  around  certain  elevation,  and 
has  been  given  analytical  expressions  derived  from  measure¬ 
ments.  A  review  of  different  ducting  formations  observed  in 
various  coastal  middle  latitude  locations  were  given  in  [40]. 
Through  extraction  of  an  uncertainty  model  from  published 
measurements,  we  solve  the  expected  PF  in  the  presence  of 
uncertain  ducting  formations. 

The  inverse  problem  of  predicting  refractive  index  profile  from 
measured  data  has  been  an  active  research  area,  where  popular 
prediction  tools  include  evolutionary-type  optimization  algo¬ 
rithms  and  Markov-Chain-Monte-Carlo  (MCMC)  method  [41]- 
[43].  Recently  Grabner,  et.  al.  have  published  their  measured 
data  that  set  a  validated  uncertainty  model  in  terms  of  several 
random  variables  (RVs)  [43]-[45],  [46,  Chapter  7].  Joint  distri¬ 
bution  of  5  RVs  are  validated  and  depicted  in  [46,  Chapter  7], 
where  it  is  assumed  that  each  of  these  RVs  is  independent  in 
moderate  perturbations  around  locations  of  high  probability  in 
the  probability  distribution  functions.  Such  an  uncertainty  in 
ducting  model  enables  one  to  tackle  field  estimation  problem, 
e.g.  compute  the  mean-power  available  at  desired  receiver  end. 
This  estimation  has  conventionally  been  carried  out  for  the 
propagation  loss  as  a  function  of  range  using  Monte  Carlo 
(MC)  sampling  [47].  In  this  work  we  perform  this  estimation 
with  sparse  grid  methods,  and  obtain  expected  field  and  power 
distributions  by  exploiting  much  less  resources  (computation 
time)  than  the  MC  sampling  and  QMC  methods. 

The  paper  is  organised  as  follows:  in  Section  II  we  briefly 
mention  the  construction  of  the  sparse  grid  in  SGC,  and  the  two 
adaptive  algorithms  that  we  use.  Section  III- A  introduces  the  1- 
D  scattering  application  in  which  the  random  dimensionality 
is  varied  from  d  =  6  up  to  d  =  100.  The  tropospheric  long- 
range  propagation  (2-D)  is  studied  in  Section  III-B,  where  the 
uncertainty  model  of  the  ducting  has  a  fixed  dimensionality  of 
d  =  5.  The  details  of  this  work  can  be  found  in  [48]. 


II.  Evaluation  of  Expectation 


It  should  be  re-stressed  that  our  goal  in  this  work  is  to 
compute  expectation  of  quantities  E[f(r,  y)],  where  E[.]  is 
the  expectation  operator,  y  =  (Yi, ..,  Yd)  is  the  vector  of  d 
independent  RVs,  and  r  is  the  vector  of  any  spatial/temporal 
variables.  The  target  function,  /,  will  be  in  the  first  application 
a  reflection  coefficient,  and  in  the  last  two  applications  the 
field  distribution  at  the  observation  range  along  the  direction 
transverse  to  propagation  axis.  We  refer  to  the  d— dimensional 
space  of  RVs  as  T.  If  we  drop  the  deterministic  arguments  r 
for  brevity, 
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E[f(y)]  =  J ..  J  f(y)pi  (Y1)..Pd(Yd)dYd..dY1 

Yl  Yd 
Q 

~  Yf(y^ai’  (i) 

5=1 

where  pk  is  the  probability  distribution  function  of  the  kth  RV, 
k  =  1,  2, ..,  d.  If  one  uses  MC  sampling,  each  sample  is  equally 
weighted,  i.e.  aq  =  1/Q  and  yq  are  drawn  totally  randomly 
from  T.  As  stated  before,  MC  sampling  will  constitute  the 
reference  method  that  we  will  compare  our  results  to.  Next,  the 
Sparse  Grid  Collocation  (SGC)  method  and  its  enhancements 
are  introduced. 

The  SGC  method  is  based  on  Smolyak’s  cubature  formula 
for  numerical  computation  of  multi-dimensional  integrals  [49], 
where  the  same  formula  was  later  generalized  to  the  broader 
problem  of  multi-dimensional  function  interpolation  [50] -[5  2] 
in  the  below  form: 


A(d,s)(f)  =  A(d,s-i)(f)  +  (2) 

where  s  >  0  is  referred  to  as  the  “level”  of  the  Smolyak 
algorithm,  with  which  both  number  of  samples  used,  Q ,  and 
interpolation  accuracy  is  expected  to  increase.  A(d,s)(f)  is 
the  sth  level  sparse  grid  approximation  to  the  d— dimensional 
function  /.  A*4(d,s)  (/)  is  a  hierarchical  interpolation  difference, 
which  can  be  regarded  as  the  functional  change  from  level  s  —  1 
to  level  s : 

AA(d,s)(f)  —  0) 

|i|i=d+-nGSi 

We  name  i  =  as  the  super-index  levels  (or  super¬ 

indices)  in  uni-dimensional  interpolations  along  each  RV,  |i|x  = 
h  +  ^2  +  •••  +  id>  and  n  =  (711,712,  ...,nd)  as  the  sub-indices, 
respectively.  Each  super-index  level  G  N+  determines  the 
number  of  nodes  that  appear  in  the  uni-dimensional  interpola¬ 
tion  formula  associated  with  Y*.,  whereas  the  value  of  E  N+ 
follows  a  convention  according  to  the  set  B p  w\ j  is  a  surplus 
value  associated  with  index  pair  (i,  n).  Together,  each  index 
pair  (i,n)  corresponds  to  a  particular  node  yq  from  T.  We  skip 

further  discussions  with  B j  and  w }j,  and  encourage  the  reader  to 
see  the  thorough  derivation  in  [52].  Lastly,  is  the  d— tensor 
product  of  uni-dimensional  basis  functions  S*n (y)  :=&(n)<8> 
...  0  €l?d(Yd),  where  (8)  is  the  tensor  product  symbol.  As  uni¬ 
dimensional  basis  functions  £ln  we  interchangeably  choose  local 
triangular  functions  or  Lagrange  characteristic  polynomials. 
When  we  use  local  triangular  functions,  the  corresponding 
nodes  are  equi-distant,  also  known  as  Newton-Cotes  nodes,  also 
chosen  in  [53].  When  we  use  Lagrange  characteristic  polyno¬ 
mial  interpolation,  we  use  Chebyshev  nodes  of  the  second  kind, 
also  known  as  Clenshaw-Curtis  nodes  [54].  Unless  otherwise 
stated,  we  keep  local  triangular  function  interpolation  and  equi¬ 
distant  node  selection  as  standard. 

Once  the  sparse  grid  for  d— dimensional  function  interpolation  is 
constructed  according  to  (2),  (3),  E[f]  can  now  be  computed  as 


superposition  of  expectations  of  hierarchical  differences,  which 
is  obtained  by  substituting  (3)  in  (1): 


E[AA{dtS)(f)}  =  Y  rv  (4) 


ri  =  Y  wn  f  CnjYi)® 

neBi  A  Yd 

®  ...®^d{Yd)PiiY1)..pd(Yd)dYd..dY1\.  (5) 

So  far,  the  SGC  construction  above  is  deterministic  in  the  sense 
that  all  nodes  in  the  sparse  grid  and  their  corresponding  basis 
tensor  products  are  a-priori  known  without  the  knowledge  of 
how  smooth  /  is  in  T.  Therefore,  the  SGC  often  suffers  accuracy 
for  non- smooth  /,  e.g.  with  singularities/discontinuities,  and 
may  result  in  redundant  sampling.  Lor  d  1,  the  SGC 
employs  Q  ~  (2 d)s / s\  predetermined  nodes  (samples)  from 
T  [22].  Therefore,  adaptive  strategies  are  inevitable  especially 
for  high— d  spaces,  which  reduce  the  number  of  samples  used 
in  sparse  grid  construction  through  sampling  of  important  sub¬ 
spaces  rather  than  a  pre-determined  sampling.  Next,  we  briefly 
present  the  two  adaptive  construction  methods  we  used  in  this 
work. 


A.  Adaptive  Sparse  Grid  Collocation  Method 

Among  several  adaptive  construction  enhancements  to  SGC,  in 
this  section  we  present  the  Adaptive  Sparse  Grid  Collocation 
(ASGC)  method  [55],  which  resulted  in  one  of  the  best  per¬ 
formances  for  interpolating  wave  propagation  problems  we  are 
interested  in.  Although  the  hierarchical  construction  we  follow 
was  detailed  and  the  term  “ASGC”  was  coined  in  [53],  the 
algorithm  in  [55]  presents  slight  differences  and  we  follow  the 
latter. 

Suppose  smax  is  a  maximum  level,  beyond  which  the  sparse 
grid  construction  terminates.  Lor  each  node  yq  considered  in 
the  sparse  grid,  a  percentage  surplus  error  is  defined  as: 

7{i  =  100  x  wln/f{yq).  (6) 

In  cases  the  function  behavior  is  smooth  with  respect  to  a  node, 
i.e.  the  surplus  rcjj  for  the  specific  node  is  not  significant  with 
respect  to  the  exact  function  value  evaluated  at  that  node,  f(yq ), 
then  simply  the  specific  node  under  investigation  is  discarded 
from  further  neighbor  refinement  in  the  sparse  grid.  This  way, 
the  sparse  grid  is  adaptively  refined  towards  the  singular,  if 
not  non-smooth  regions  in  T.  (e.g.  see  [53],  Lig.7).  The  error 
threshold  for  adaptivity  can  be  assumed  in  different  means.  We 
use  a  constant  mean  percentage  error  threshold  te,  where  the 
error  is  defined  as  in  (6). 

The  ASGC  method  has  recently  been  applied  to  several  prob¬ 
lems  [55],  [56].  Although  it  introduced  a  hyper-cube  refine¬ 
ment  strategy  to  sample  only  important  subspaces  of  T,  it 
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can  still  suffer  the  “curse  of  dimensionality”  for  moderate- 
to-high— d  problems,  depending  on  smoothness  of  /.  In  [29], 
decomposition  of  the  target  function  /  into  lower  dimensional 
component  functions,  and  tackling  each  component  function 
with  ASGC  was  established.  This  decomposition  is  based  on 
the  high  dimensional  model  representations  (HDMR)  of  [26], 
[27]: 


d 

f(y)  =  fo  +  E/^)+  E 

i=  1  l<ii<i2<d 

+  •••+  E  ...,Yip) 

+  •••  +  /i2...d(Ei, Yd),  (7) 

where  /o  is  a  constant  term  and  is  equal  to  the  evaluation  at  the 
origin  of  T,  f{yorigin ),  and  fili2...ip  are  pth  order  component 
functions,  that  account  for  the  contribution  of  p- tuple  RVs 
(Yl,Y2,  --,YP)  into  /.  The  component  index  u  = 
is  used  to  represent  the  RVs  that  are  included  in  the  component 
/u(lii).  For  several  physical  systems  it  has  been  shown  that  the 
first  few  order  components  in  (7)  dominate  the  overall  behavior 
of  /,  thus  majority  of  the  components  can  be  eliminated,  or 
adaptive  selection  among  them  are  allowed.  It  should  be  stressed 
that  the  expansion  in  (7)  is  nested,  in  the  sense  that  even  if  no 
adaptive  elimination  of  components  is  applied,  no  extra  nodes 
are  introduced  to  the  sparse  grid  when  (7)  is  utilized  prior  to 
interpolation  with  ASGC.  Henceforth,  we  refer  to  this  technique 
as  HDMR+ASGC.  The  procedure  we  use,  which  follows  [29] 
except  for  a  sub-routine,  is  summarized  below: 


put  in  both  X  and  Tu,  where 


Vj  = 


\m]\Ll(D) 

I/oIli(D) 


(8) 


where  as  the  first  norm  |.| Ll^Dy  we  use  the  sum  of 
absolute  values  of  the  evaluated  function  at  each  spa¬ 
tial/temporal  variable  r  ( f(y )  =  f(y:  r)). 

7)  while  p  <  pmax 

•  Components  to  be  considered  (at  order—  (p  +  1)) 
are  obtained  by  the  routine  Comp  Admit  (., .),  which 
is  detailed  later  in  this  section,  and  these  com¬ 
ponents  are  put  in  the  admissible  set:  1ZU  <— 

Comp  Admit  (TU,X). 

•  ru  =  0. 

•  If  7 Zu  7^  0,  for  each  component  u  from  7 Zu 
use  ASGC  with  parameters  Smax  and  te  to  get 

E[fu(yu)}- 

-  for  each  u  from  7 Zu  compute  error  iju,  where 


\ElfuWMD1 


E  E[h] 

vec„,|v|<|u| 

Li(D) 

-  Put  component  u  into  Cu 

-  if  m  >  0  put  component  u  into  Tu. 

-  endfor 

-  nu  =  0. 

•  p  =  p  +  i. 

8)  endwhile 


(9) 


1)  Let  6  denote  a  threshold  value,  which  will  be  used  as 
an  indicator  for  an  elimination  to  be  explained  later.  For 
example,  0  =  0.01  means  that  the  elimination  will  be 
based  on  1%  error. 

2)  Let  Pmax  £  N+  denote  the  maximum  order  at  which 
HDMR  in  (7)  will  be  truncated,  i.e.  it  represents  the 
highest  dimensionality  a  component  in  (7)  can  have. 

3)  Pre-determine  parameters  of  the  ASGC  method  to  be 
accessed:  determine  Smax  and  te  of  Section  II-A. 

4)  Now  define  four  sets  that  hold  component  vectors  (u), 

•  7 Zu:  set  of  “admissible”  components,  which  are  order 
p- 1-1  each.  The  set  is  redefined  at  each  order  p,p  — 

0,  1,  ..,  Pmax  1- 

•  Tu\  set  of  “selected”  components,  redefined  at  each 
order  according  to  0  criterion. 

•  Cu :  set  of  “all”  components  considered  in  the  coarse 
of  HDMR.  This  set  will  monotonically  enlarge,  where 
the  cardinality  of  this  set  can  never  exceed  2d  accord¬ 
ing  to  (7). 

•  X:  set  of  “important  dimensions”,  i.e.  important  order- 
1  components  out  of  the  N  order- 1  components  in 
(7). 

5)  Set  TZU  =  0,  Tu  =  0,  Cu  =  0,  X  =  0.  Compute  /0  = 

/ (jj origin)  •  Set  p  =  1. 

6)  Interpolate  each  of  the  d  order- 1  components  using  ASGC 
with  parameters  smax  and  te,  and  compute  E[fj],  j  = 
1,2,..,  iV.  Add  each  order- 1  component  {j}  in  Cu.  Those 
order- 1  components  that  satisfy  7 y  >  0  are  labelled  as 
being  “important”,  and  only  these  components  {j}  are 


Next,  we  discuss  how  the  order—  (jp  +  1)  components  are 
admitted,  given  the  set  of  “important”  dimensions  ( X )  and 
order— p  components  already  computed  (Tu). 


Comp  Admit  (Tu ,  X) 

This  routine  is  the  main  difference  we  have  with  respect  to 
the  procedure  in  [29],  where  they  use  a  more  conservative 
component  admission  strategy  than  ours.  We  have  experienced 
in  general  better  results  with  our  selection.  Below  routine 
returns  the  components  to  be  admitted  at  order—  (p  +1).  The 
assumption  is  that  all  components  in  the  input  Tu  are  order— p. 

.  nu  =  0 

•  for  n  =  1,  n  <  X.size(),  n  +  + 

-  for  m  =  1,  m  <  7^.size();  m- j-  + 

*  if  n  £  Xu{m ),  then  1ZU  =  7 Zu  U 

C oncatenate{Tu(m) ,  n} . 

-  endfor 

•  endfor 

•  return  1ZU. 

The  concatenation  of  component  vectors  restricts  ascending 
order,  and  a  component  vector  can  contain  unique  integers  only. 
For  instance,  Concatenate^  1,  2,  3},  {1, 4}}  =  {1,  2,  3, 4}.  Fi¬ 
nally,  we  demonstrate  a  sample  adaptive  component  elimination 
in  Table  I,  for  a  d  =  5— dimensional  system  that  will  be 
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studied  in  Section  III-B.  This  elimination  was  performed  with 
9  =  10-4.  Note  that  the  first  RV,  that  corresponds  to  the 
component  f\  from  (7)  and  component  vector  {1}  in  Table 
I,  produces  an  indicator  of  10_n,  and  is  the  only  unimportant 
dimension  according  to  9  =  10-4.  Out  of  the  31  components 
(other  than  /o)  present  for  this  5— dimensional  system,  14  of 
them  were  considered  and  interpolated  with  an  ASGC  solver 
with  parameters  te  =  0.5  and  smax  =  6.  Indeed,  the  elimination 
in  Table  I  resulted  in  use  of  1, 777  nodes  (samples)  to  evaluate 
/  at,  whereas  the  SGC  method  (non-adaptive)  of  smax  =  6  in 
a  5— dimensional  space  requires  6,993  evaluations  irrespective 
of/. 

TABLE  I 

The  errors  nu>  for  a  sample  HDMR+ASGC  component  elimination 

PERFORMED  FOR  THE  APPLICATION  IN  SECTION  III-B  ( d  =  5). 


u 

m 

u 

m 

{1} 

10 il 

{3,4} 

1.03  x  10"3 

{2} 

0.0160 

{3,5} 

5.31  x  10“4 

{3} 

0.0761 

{4,5} 

3.20  x  10"3 

{4} 

9.21  x  10-a 

{2,3,4} 

4.01  x  10-b 

{5} 

0.0206 

{2,3,5} 

7.04  x  10 e 

{2,3} 

1.89  x  10“4 

{3,4,5} 

9.10  x  10-5 

{2,4} 

5.18  x  10-& 

{2,5} 

1.56  x  10“e 

B.  h-Adaptive  Generalized  Sparse  Grid  Method 

The  second  adaptive  strategy  we  will  apply  for  computing  E[f] 
is  the  h— Adaptive  Generalized  Sparse  Grid  (ft— GSG)  method 
[32].  Different  from  ASGC,  this  method  creates  an  adaptive 
refinement  not  only  in  the  nodes  of  the  sparse  grid,  but  also  in 
the  super-indices  i.  The  method  dates  back  to  [57],  where  in 
the  original  work  only  super-indices  i  are  adaptively  selected, 
and  all  nodes  entailed  with  i  according  to  the  node  set  B-v 
are  included  in  the  sparse  grid.  In  h— GSG  however,  adaptive 
refinement  in  between  the  nodes  in  of  a  selected  index  i  is 
also  present.  As  it  was  the  case  with  ASGC  method,  we  can 
either  use  equi-distant  nodes  or  Chebyshev  nodes.  The  reader 
is  referred  to  [32]  for  the  details  of  the  algorithm. 

While  both  HDMR+ASGC  and  h— GSG  have  different 
strengths,  it  is  in  general  easier  to  optimize  the  parameters  of 
ft— GSG,  as  it  only  uses  a  single  parameter:  etoi-  However,  in 
HDMR+ASGC,  there  are  a  total  of  3  parameters  to  optimize  for 
best  convergence,  thus  this  method  suffers  from  lack  of  easiness 
of  optimization  compared  to  ft.— GSG.  To  perform  indexing  and 
node  search  operations  present  in  sparse  grid  methods  in  a  fast 
way  we  used  the  standard  set  library  of  C++,  and  as  an  efficient 
linear  algebra  package  the  Eigen  library  [58]. 


III.  Numerical  Applications 

A.  First  Scattering  Example:  Reflection  from  multi-layered 
slabs 

A  test  case  to  study  performance  of  sparse  grid  methods  is 
the  problem  of  plane  wave  normally  incident  on  a  series  of 


infinite  (in  the  transverse  plane)  planar  dielectric  slabs  of  finite 
thicknesses  as  shown  in  Figure  1,  where  the  K  slabs  are 
assumed  to  exist  between  two  open  half-infinite  free  space 
regions.  The  parameters  of  the  fcth  slab  are  the  thickness  ft*, 
permittivity  e*,,  permeability  //;{:,  conductivity  a/{:,  and  thus 
complex  wave  number  7^, ,  k  =  1,2 This  example  is 
instructive  because  it  will  explain  how  sparse  grids  may  be 
applied  to  more  complicated  scattering  problems,  such  as  rough 
surface  scattering.  The  target  in  this  example  is  to  compute 
expected  value  of  the  reflection  coefficient,  |  £7  [77]  | ,  where  R 
is  the  reflection  coefficient  for  the  normally  incident  wave,  as 
depicted  in  Figure  1. 


Fig.  1.  Normal-incidence  reflection  from  multi-layered  media. 


The  analytical  solution  for  R  is  straightforward  to  derive  utiliz¬ 
ing  oppositely  directed  plane  wave  pair- solutions  in  each  slab 
and  enforcing  field  continuities  at  interfaces,  for  which  we  refer 
the  reader  to  [59,  Chapter  5].  The  series  of  examples  that  will  be 
considered  next  will  shed  light  on  the  convergence  performance 
of  the  sparse  grid  methods  applied  to  the  canonical  reflection 
problem  discussed  above.  In  all  the  results,  we  seek  the  mean 
value  |£’[i?]|  of  the  reflection  coefficient.  These  examples  are 
listed  in  Table  II  along  with  the  reference  solution  (exact 
\E[R]\),  at  the  operating  frequency  of  300  MHz. 


TABLE  II 

List  of  examples  considered  in  Section  III-A. 


Example 

K 

d 

RV  List 

RNI 

(reference) 

Fixed  Values 

1 

3 

6 

ei,e2,e3, 

AM,  M2,  M3 

0.010320 

crk  =  lmSIm, 
hk  =  0.5m, 
k=l,2,3. 

2 

10 

20 

<M,  eio> 

AM, AMO 

0.60437 

(Ji  =  1.67mS/m, 
(jk  =  0,  k  /  1. 
hi  =  2m, 
hk  =  0.5m, 
k  7^  1. 

3 

50 

100 

<M, 650, 

AM,  M 50 

0.63423 

cr  i  =  1.67mS/m 
ak  =  0,  k  ^  1. 
hi  =  2m, 
hk  =  0.1m, 
k  +  1. 

The  series  of  examples  that  will  be  considered  next  will  shed 
light  on  the  convergence  performance  of  the  sparse  grid  methods 
applied  to  the  reflection  problem.  In  all  the  results,  we  seek  the 
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mean  value  \E[R]  of  the  reflection  coefficient.  These  examples 
are  listed  in  Table  II  along  with  the  reference  solution  (exact 
|  E [7?]  | ),  at  the  operating  frequency  of  300  MHz. 

The  first  example  is  the  case  of  a  three  infinite  slabs  inserted 
in  free  space,  with  6  RVs  ( d  =  6):  relative  permittivity  and 
relative  permeability  of  each  slab  are  uniform  RVs  e  =  U[l,  2], 
/j,  =  U[l,  2].  Each  slab  is  0.5  m  thick,  and  each  has  conductivity 
1  mSy meters.  The  magnitude  of  the  mean  reflection  coefficient 
is  |  =  0.010320,  which  is  obtained  from  107  MC  samples, 
where  the  convergence  results  are  shown  in  Figure  2,  in  which 
the  first-norm  errors  are  defined  as: 

7~ i  |  htar  ^re/ 

ErrLl  =  1 - - - (10) 

|^re/| 

where  htar  and  href  are  the  estimate  and  exact  (reference) 
E[R],  respectively.  In  this  particular  example  we  consider  a 
case  where  each  individual  RV  and  p— tuple  combinations  of 
RVs  contribute  significantly  to  the  target  function  R ,  where  p 
corresponds  to  the  component  orders  in  (7).  In  Figure  2  the 
error  convergence  for  MC  sampling,  ASGC  and  HDMR+ASGC 
are  depicted.  The  ASGC  solution  was  applied  with  Chebyshev 
nodes,  with  a  threshold  parameter  te  =  0,  therefore  it  is  indeed 
a  non-adaptive  solution  (SGC).  The  markers  on  the  ASGC 
curve  denote  errors  for  increasing  levels  s,  as  a  function  of 
the  nodes  ( Q )  used  in  the  sparse  grid.  Note  that  the  error 
attained  at  level  8  =  5,  using  4,865  samples,  is  much  lower 
than  the  MC  sampling  would  attain  with  106  samples.  The 
HDMR+ASGC  curve  on  the  other  hand  depicts  the  errors  with 
increasing  component  orders  p ,  while  keeping  Smax  =  5  in 
the  algorithm  in  Section  II- A,  as  a  function  of  Q.  The  HDMR 
error  indicator  was  selected  with  0  =  0,  and  pmax  =  N  =  6, 
so  that  the  decomposition  in  (7)  does  not  make  any  component 
elimination,  and  at  order  Pmax  =  N  =  6  completely  recovers 
the  ASGC  solution  it  was  applied  upon.  In  Figure  3,  component 
importance  indicators  r] u  are  depicted  as  a  function  of  the  index 
of  the  components  u.  Note  that  for  this  example  there  are  a 
total  of  26  components  in  (7),  and  all  r]U  except  for  the  0th 
order  term  are  depicted  (rjo  =  1  always).  It  is  obvious  in  Figure 
3  that  unlike  the  general  use  of  HDMR+ASGC  algorithm  for 
dimensionality  reduction,  this  example  reveals  a  case  where 
all  components  up  to  p  =  5th  order  are  quite  important,  and 
cannot  be  eliminated.  This  is  also  obvious  in  Figure  2  that 
the  HDMR+ASGC  error  is  quite  high  unless  all  components 
are  included.  Through  Example  1,  we  have  considered  a  case 
where  the  physics  of  the  geometry  and  the  RVs  assumed  therein 
do  not  allow  adaptation  along  certain  reduced  dimensional 
subspaces  of  the  6— dimensional  space  (T).  It  is  in  general  the 
case  in  the  K-Slabs  problem  in  this  section,  that  unless  some 
RVs  are  deliberately  made  less-important,  all  permittivities  and 
permeabilities  are  comparably  important  in  the  input  reflection 
coefficient  R.  The  convergence  rates  listed  in  the  legend  are 
obtained  from  the  slopes  of  the  best-fit  lines  for  each  curve. 
Note  that  MC  sampling  curve  has  a  rate  of  Q~0A 12 ,  which  is 
in  the  asymptotic  case  expected  as  0(1/ \/Q).  It  is  an  indication 
that  the  target  function,  R ,  has  a  large  dynamic  range  in  T  and 
a  sample  size  bigger  than  107  would  be  required  to  achieve 

1/ VQ  rate. 


Example  2  is  the  case  of  10  dielectric  slabs,  thus  the  problem 
is  d  =  20— dimensional.  In  this  example,  the  thickness  of  the 
first  slab  is  h\  =  2  meters,  whereas  the  other  nine  slabs  have 


Fig.  2.  Error  convergence  for  Example  1  of  Section  III-A  for  MC  sampling, 
ASGC  method  for  increasing  levels  s,  and  HDMR+ASGC  for  increasing 
component  orders  p. 


Fig.  3.  ?7u  corresponding  to  the  components  of  the  HDMR  expansion 

(HMDR+ASGC  curve)  in  Figure  2. 
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thicknesses  ft2  =  ^3  =  •••  =  ft  10  =  0.5  meters.  Accordingly,  for 
the  purpose  of  creating  a  high-impedance  first  slab  compared 
to  the  remaining  nine  slabs,  all  RVs  are  identical  and  uniform, 
except  that  the  permeability  of  the  first  slab  is  much  higher  than 
other  permeabilities:  ei,  e2, ..,  ew,p,2,  p-3,  ..,pw  ~  U[  1,1.5], 
and  /1 1  ~  f/[20,21].  With  such  distinction  of  from  other 
RVs,  and  the  first  slab  being  four  times  thicker  than  the  other 
slabs,  the  random  problem  becomes  more  fluctuating  due  to  the 
uncertainty  in  /zi  than  other  RVs.  Figure  4  depicts  the  first  norm 
errors  for  Example  2  with  respect  to  107  MC  samples,  which 
gives  the  reference  value  of  |-E[.R]  |  =  0.60437.  For  this  example 
we  also  include  QMC  results  with  Sobol  and  Halton  sequences. 
Note  that  both  sequences  attained  a  lower  error  than  MC,  Sobol 
has  a  convergence  of  Q-0'637  and  Halton  has  a  convergence  of 
Q~ °'653.  On  the  other  hand,  both  HDMR+ASGC  and  ft- GSG 
have  significantly  improved  convergence  with  respect  to  MC 
and  QMC.  The  ft— GSG  sparse  grid  construction  terminated 
after  having  used  Q  =  855  samples,  where  the  tolerable 
error  level  parameter  of  ft— GSG  was  etoi  =  10-4.  For  the 
HDMR+ASGC,  the  parameter  set  was  0  =  10-4,  srnax  =  6, 
and  /,,  =  0.2%.  The  HDMR  algorithm  terminated  after  order 
p  =  2,  which  used  Q  =  692  nodes  and  attained  more  than  two 
orders  of  magnitude  less  error  than  the  MC  sampling  with  the 
similar  Q.  The  error  that  ft.— GSG  attained  with  855  samples 
is  even  lower,  and  represents  a  lower  error  than  MC  sampling 
with  106  samples  has. 


o 


a) 

CL 


O 

CD 


O 

c= 

I 


H-  h-GSG  (CT0931) 
-*“HDMR+ASGC(  CT0'583) 
Sobol  (CT0637) 

. Halton  (CT0-653) 


Q  (#  of  samples  used) 


Fig.  4.  Error  convergence  for  Example  2  of  Section  III- A 


Example  3,  the  last  example  of  this  section,  is  a  50  dielectric 
slabs  problem,  which  makes  T  100— dimensional.  Through  this 
example  we  intend  to  demonstrate  a  high-dimensional  case  ( d  = 
100)  where  the  randomness  in  T  is  highly  along  a  specific  RV, 
which  we  expect  to  be  ideal  for  interpolating  with  h— GSG.  Our 
experience  and  related  literature  shows  that  the  methods  based 
on  SGC,  which  is  ASGC  and  HDMR+ASGC  in  our  case,  fail 
to  attain  better  convergence  than  the  MC  and  QMC  with  such 
high-dimensional  examples.  The  difference  of  thicknesses  of 


slabs  is  made  very  severe:  hi  =  2  meters,  h<i  =  /13  =  ...  = 
/150  =0.1  meters.  Similar  to  Example  2,  only  the  permeability 
of  the  first  slab  (/i  1)  is  assigned  a  large  support  and  all  other  99 
RVs  have  much  more  restricted  variation.  This  time  we  assume 
normal  RVs,  where  the  two  arguments  of  a  normal  variable 
7V[., .]  stand  for  the  mean  and  the  standard  deviation.  The  99 
restricted  RVs  are  61,62, 650,  H2,  H 3, /iso  ^  /V[l,  0.05],  and 
Hi  ~  TV [20,  0.5].  Figure  5  depicts  the  performance  of  QMC  and 
sparse  grid  methods  in  Example  3  with  respect  to  the  reference 
solution.  The  reference  solution  in  this  case  was  obtained  with 
4  x  108  samples.  Note  in  Figure  5  that  the  performance  of  both 
QMC  sequences  are  slightly  better  than  MC  sampling,  yet  are 
not  worse  than  the  20— dimensional  case  in  Example  2.  This  is 
an  indication  that  although  we  have  a  100— dimensional  problem 
in  Example  4,  the  randomness  in  T  is  not  significantly  higher 
than  in  Example  2.  As  expected,  in  Figure  5  the  performance 
of  h— GSG  method  is  the  best  of  all  methods  considered,  and 
terminated  at  Q  =  2,029  with  etoi  =  10-6.  The  fast  decaying 
pattern  in  the  error  of  h— GSG  curve  represent  a  super-index 
search  along  the  axis  of  the  Hi  RV,  for  this  example  basically 
only  that  axis  is  very  densely  discretized  due  to  its  importance. 
The  HDMR+ASGC  on  the  other  hand,  terminates  after  order 
p  =  2,  and  cannot  draw  nearer  to  the  reference  solution  in 
a  decent  sparse  grid  size.  This  is  mainly  due  to  the  fact,  as 
explained  earlier  in  Section  II-A,  that  the  ASGC  method  at  level 
s  considers  admissibility  of  all  indices  altogether,  that  satisfy 
|i|i  =  d  +  s,  thus  unlike  h— GSG  cannot  perform  adaptivity 
along  a  single  axis  of  T. 

The  HDMR+ASGC  method,  as  depicted  in  Figure  5,  terminated 
after  order  p  =  2  with  a  sample  size  of  Q  =  1, 091.  The  peak 
physical  memory  taken  during  this  execution  was  monitored  as 

5.3  MB  and  the  method  elapsed  170  seconds  before  termination. 
On  the  other  hand,  the  h— GSG  execution,  which  terminated 
after  Q  =  2,  029,  took  14  MB  of  peak  physical  memory  and  a 
total  of  70  seconds.  These  are  tabulated  in  Table  III.  Note  that 
above  values  reflect  the  cost  of  sparse  grid  methods,  since  an 
analytical  solver  is  used  in  this  section.  For  both  sparse  grid 
codes,  it  is  a  general  trend  that  as  Q  monotonically  increases, 
so  does  the  memory  in  a  linear  fashion.  We  think  this  is  due 
to  the  dynamic  sized  sets  of  objects  that  we  store  sparse  grid 
nodes’  attributes  in.  Each  object  in  the  set  has  attributes  for  its 
position  in  T,  its  super-index  i,  and  its  sub-index  n.  For  holding 
these  objects  the  standard  set  library  of  C++  is  used.  As  a  linear 
algebra  package  we  used  the  Eigen  library  [58].  Similarly,  for 
the  MC  sampling,  the  memory  usage  increases  almost  linearly 
with  Q ,  and  for  the  above  considered  problem,  each  of  MC 
sampling  and  QMC  methods  with  Q  =  2,000  samples  took 

2.4  MB  of  physical  memory.  Although  the  memory  usage  of 
sparse  grid  methods  depend  on  how  the  operations  with  the 
nodes  in  T  are  performed,  the  above  numbers  suggest  that 
for  a  d  =  100— dimensional  problem,  the  sparse  grid  methods 
take  memories  in  the  order  of  megabytes.  In  cases  where  the 
deterministic  solver  is  a  very  heavy  numerical  solver,  e.g.  that 
involves  inversion  of  large  dense  matrices,  above  values  of 
memory  and  time  in  Table  III  will  be  negligible  compared  to 
those  taken  by  the  solver.  This  will  be  verified  in  the  next  section 
through  demonstration  of  error  evolution  with  total  elapsed  time. 
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Q  (#  of  samples  used) 


Fig.  5.  Error  convergence  for  Example  3  of  Section  III- A 


TABLE  III 

Memory  and  time  usages  in  Example  3  of  Section  III-A. 


Method 

Samples  Used 

(Q) 

Peak  Physical 
Memory 

Total  Time 

MC&QMC 

2,000 

2.4  MB 

0.54  sec. 

HDMR+ASGC 

1,091 

5.3  MB 

170  sec. 

h-GSG 

2,029 

14  MB 

77  sec. 

B.  Application  in  Tropospheric  Propagation:  Field  Estimation 
in  Long-Range  Uncertain  Ducting  Environments 


This  section  is  reserved  for  the  above  d  =  5— dimensional  appli¬ 
cation  which  will  demonstrate  strength  of  sparse  grid  methods 
through  a  more  realistic  propagation  scenario.  The  objective 
is  to  compute  expected  signal  strength  over  flat  Earth  surface 
at  ranges  far  from  the  transmitter  location,  where  randomness 
is  present  due  to  uncertain  refractive  index  of  the  atmosphere. 
This  is  a  far-range  propagation  problem  that  one  has  to  take  the 
effective  radius  of  the  Earth  into  account,  where  the  Helmholtz 
equation  needs  to  be  modified  accordingly.  This  scenario  is 
depicted  in  Figure  6  for  waves  propagating  long  distances  in 
shallow  angles  with  respect  to  the  main  propagation  axis,  x, 
that  is  tangential  to  the  Earth  surface  everywhere.  The  z  axis 
is  normal  to  the  surface,  and  ae  is  the  effective  radius  of  the 
Earth.  The  standard  parabolic  equation  in  the  atmosphere  is 
approximated  from  the  modified  Helmholtz  equation  as  [60]: 


dx 


i  d 2 
2  kQ  dz 2 


H-  iK 


n(z)  H - 1 

CLp 


(ID 


where  kQ  is  the  wavenumber  in  free-space,  i  =  T-  The 
quantity  'ip(x^z)  is  a  reduced  field  that  constitutes  as  a  one¬ 
way  approximation  to  the  full- wave  solution  in  atmosphere. 
The  refractive  index  of  the  atmosphere,  n ,  is  assumed  to 
smoothly  deviate  from  the  homogeneous  case  as  a  function  of 


elevation  (z)  only.  This  is  a  valid  assumption,  and  has  mostly 
been  modeled  as  having  a  slight  negative  gradient  in  z  at 
lower  elevations.  A  more  general  “ducting”  phenomenon,  which 
appears  up  to  few  hundred  meters  elevation  mostly  in  coastal 
locations,  has  been  observed  [37],  whereas  in  this  work  we  use 
the  following  duct  model  from  [46,  Chapter  7]: 


AT/  \  AT  ^  dN  ,  2.9 6(z  —  h0) 
N(z)  —  N0  +  Gjsrz  H — —  tanh - — - , 


(12) 


where  7V0  (N-units)  is  the  nominal  refractivity,  Gn  (N-units) 
is  the  gradient,  d/V(N-units)  is  the  duct  depth,  hQ  (meters)  is 
the  duct  height,  dh  (meters)  is  the  duct  height  and  N-units 
is  a  measure  of  small  changes  in  the  true  refractive  index, 
N  =  (n  —  1)  x  106.  The  refractivity  N  is  related  to  the  often- 
used  modified  refractivity  M  through  N  =  M  —  I06z/ae.  To 
give  a  demonstration,  a  realization  of  TV,  M  according  to  (12)  is 
depicted  in  Figure  7.  The  slopes  of  N  at  small  and  large  heights 
are  shown  as  dotted  lines  and  are  seen  to  be  similar.  From 
the  joint  cumulative  distribution  functions  in  [46,  Chapter  7], 
we  choose  to  assume  supports  of  each  of  the  5  RVs  to  be 
independent  and  uniform.  The  nominal  refractivity  is  a  uniform 
RV  E/[300,340]  N-units,  GN  is  U[- 0.057,-0.017]  N-units/m, 
dN  is  U[— 7.5,  2.5]  N-units,  hQ  is  U[ 20,70]  meters,  and  dh 
is  £/[10,60]  meters.  These  supports  were  selected  from  where 
each  probability  distribution  have  their  maxima  in,  out  of  the 
measured  data  in  [46,  Chapter  7],  and  where  the  cumulative 
distributions  roughly  increase  linearly,  so  that  uniform  RV  as¬ 
sumption  makes  sense  and  the  assumed  randomness  constitutes 
the  majority  of  the  randomness  present  in  the  measured  data. 


Source  Location 


Fig.  6.  The  2-D  (x,  z)  environment  at  every  range  (x)  on  the  Earth  surface, 
defined  with  respect  to  the  source  location. 


Equation  (11)  has  conventionally  been  solved  with  the  split- 
step  parabolic  equation  (SSPE)  propagator  [60].  Among  other 
computational  advantages  of  this  propagator,  a  march-along- 
range  computation  that  is  performed  every  range  step  Ax  makes 
it  advantageous  for  propagation  far  ranges  from  the  transmitter. 
With  the  assumption  of  perfectly  conducting  smooth  Earth 
surface,  the  SSPE  makes  use  of  sine-transforms  to  update  the 
field  quantity  along  x: 

oo 

ip(xa  +  Ax,  z)  =  eiko(m-i)Ax  J  e~ip2iiA0^XoiP)  sin  pz  dp, 

0 

(13) 


http://mc.manuscriptcentral.com/tap-ieee 


Page  9  of  28 


IEEE  Transactions  on  Antennas  &  Propagation 

59 


9 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 


Fig.  7.  Refractive  index  profile  according  to  (12),  where  Na  =  320  N-units, 
Gn  =  —0.037  N-units/m,  dN  =  —10  N-units,  h0  =  45  meters  and  dh  =  35 
meters. 


Fig.  8.  PF  (in  dB  scale)  corresponding  to  the  2,000  relizations  of  N  at 
t0bs  —  100  km. 


where  m  is  an  average  modified  refractive  index  in  the  range 
step  (x0,x0  +  Ax)  which  can  tolerate  only  smooth  variation 
in  refractive  index  along  height.  The  modified  refractive  index 
is  m  =  n  +  z/ae.  The  forward  sine-transform  that  transforms 
^-varying  field  into  the  spectral  p-domain  is: 

oo 

ip(x,p)  =  —  i/;(x,z)  sin pz  dz.  (14) 

7T  J 

0 


Note  that  the  Dirichlet  boundary  condition  on  Earth  surface,  viz., 
^(x,  0)  =  0  is  already  satisfied  in  (13).  Before  each  of  forward 
and  backward  transforms  in  the  course  of  the  propagator  above, 
the  nonzero  field  quantity  at  a  designated  truncation  height  zmax 
however  needs  to  be  smoothly  tapered  to  prevent  numerical 
reflections  incurred  in  numerical  transforms.  For  this,  at  each 
step  we  pre-multiply  spatial  and  spectral  quantities  with  a 
Hanning  window  as  suggested  in  [60].  To  give  an  idea  of  the 
dynamic  range  of  propagated  fields  in  the  presence  of  the  above 
uncertainty,  2,000  independent  realizations  of  the  propagation 
factor  (PF)  variation  at  the  observation  range,  x0iJS  =  100  km,  is 
shown  in  Figure  8.  The  PF  is  defined  as  the  total  observed  field 
in  the  presence  of  inhomogeneous  atmosphere,  normalized 
by  the  free-space  field: 


PF  = 


^(xobs,z) 
41 Fsfaobs ,  z) 


(15) 


The  source  function  that  we  use  in  this  section,  that  is  excited 
at  x  =  0,  is  a  Gaussian  aperture  distribution  with  height  zt  and 
width  crt\ 


v>(0  ,z)  =  Ae-^Z-Zt^^,  (16) 

which  leads  to  the  following  free-space  field  received  at  (x,  z ) 


[61]: 


XpFS(x,z)  =  =  e-(z-ztf/2(a2t+ix/ko)'  (1?) 

Vat  +  ix/kQ 


We  will  demonstrate  three  case  examples,  where  in  all  of 
them  the  operating  frequency  is  300  MHz.  For  the  first  two 
examples  zt  =  50  meters,  crt  =  2  meters  and  x0bs  =  100 
km,  whereas  for  the  third  example  zt  =  100  meters,  crt  =  1 
meters  and  x0bs  =  150  km.  These  source  widths  correspond 
to  less  than  15°  elevation  beam  width  with  respect  to  x— axis 
[62],  which  creates  a  fairly  moderate  spectral  content  span 
that  is  accurately  propagated  with  SSPE.  The  observation  of 
field  along  elevation  is  between  the  Earth  surface  z  =  0, 
and  Zmax  =  375  meters.  This  height  is  safely  above  the 
elevations  around  which  ducting  phenomena  occur,  therefore 
does  not  lack  generality  in  including  uncertainty  of  the  whole 
ducting  regime.  In  Example  1  the  PF  is  the  target  function, 
i.e.  we  are  interested  in  estimating  E[PF(  100  km,  z\y)\.  The 
complex  field  is  the  target  function  in  Example  2,  i.e.  estimate 
of  P[/0(1OO  km,  z;y)\.  Fastly  in  Example  3,  for  the  sake  of 
of  investigating  the  effect  of  observation  range  on  sparse  grid 
performances,  the  PF  at  150  km  range  is  chosen  as  the  target 
function,  i.e.  estimate  of  £?[PF(150km,  2;  y)\. 

Figure  9  depicts  the  error  convergence  with  respect  to  a 
reference  solution  for  Example  1.  The  reference  solution  for 
comparing  all  E[PF(x0i)S,  z\  y\  estimates  is  obtained  from  MC 
simulation  with  Q  =  2  x  106  random  samples.  Since  we  are 
interested  in  estimating  distributions  in  this  section,  the  first 
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norm  error,  in  the  vertical  axes  is  defined  as: 


Err  Li  = 


■ max 

J  |  ^tar(^)  href(z')  \  dz 
_0 _ 

Zmax 

f  \href(z)\  dz 
0 


(18) 


where  htar  and  href  are  the  computed  target  and  the  reference 
solutions,  respectively.  For  the  HDMR+ASGC  method,  with 
only  Q  =  135  samples  the  error  attained  is  lower  than  the 
error  MC  sampling  would  attain  with  106  samples.  On  the  other 
hand,  the  h—GSG  method  terminated  after  using  167  samples, 
and  attained  less  error  than  with  105  MC  samples.  On  the  other 
hand,  the  convergence  of  QMC  methods  with  Sobol  and  Halton 
sequences  in  Figure  9  attained  0(Q-0,638)  and  O(Q~0-803) 
rates,  respectively.  For  instance,  the  HDMR+ASGC,  with  135 
samples,  attained  less  error  than  the  Halton  sequence  with 
5,000  samples.  In  Figure  10  sparse  grid  estimates  for  PF 
are  compared  to  the  reference  solution  and  to  MC  sampling 
estimate  with  comparable  Q.  Note  that  the  HDMR+ASGC 
estimate  ( Q  =  135)  and  h—GSG  estimate  ( Q  =  167)  are 
indistinguishable  from  the  reference,  whereas  the  MC  sampling 
with  Q  =  200  samples  results  in  discrepancy  of  2  dB  at  50m 
and  0.9  dB  at  200m  elevation. 


Example  2  targets  the  complex  field  estimate  at  x0bs  =  100  km 
-£’['0(  100km,  2;  y)\.  The  error  convergence  and  field  estimate 
magnitudes  are  depicted  in  Figures  11  and  12,  respectively. 
In  this  example,  both  sparse  grid  methods  resulted  in  taking 
more  samples  compared  to  previous  case  in  general.  This 
can  be  assessed  as  the  power  quantity  being  statistically  less 
fluctuating  than  the  real  and  imaginary  parts  of  the  complex 
field.  Nevertheless,  the  HDMR+ASGC  is  still  much  steeper  in 
convergence  compared  to  MC,  and  at  p  =  3  component  order, 
using  Q  =  728  samples,  attains  less  error  than  the  MC  sampling 
estimate  of  106  samples.  The  h—GSG  in  this  case  however  takes 
much  more  samples  than  in  Example  1  for  converging  to  the 
reference  solution.  From  the  statistical  point  of  view  this  can 
be  explained  with  the  fact  that  as  the  important  hyper-cubic 
regions  of  T  are  separated  from  the  individual  axes,  dimension- 
adaptive  methods  like  h—GSG  render  less  accurate  in  such 
cases.  This  is  where  methods  based  on  ASGC  are  favorable, 
as  we  witness  in  this  problem.  Although  h—GSG  uses  orders 
of  more  samples  than  the  HDMR+ASGC,  it  attains  less  error 
than  the  MC  sampling  estimate  with  106  samples.  In  Figure 
12,  it  is  clear  that  a  MC  estimate  with  Q  =  20,  000  samples  is 
much  more  inaccurate  than  both  sparse  grid  methods,  whereas 
the  best  accuracy  is  attained  with  HDMR+ASGC  with  only  728 
samples. 

In  Example  3,  the  effect  of  range  on  the  uncertainty  is  in¬ 
vestigated  by  observation  at  x0bs  =  150  km.  Figures  13  and 
14  depict  the  error  convergence  and  PF  estimate  comparisons, 
respectively.  As  expected,  the  received  power  levels  at  this  range 
are  weaker  than  in  Example  1.  The  h—GSG  and  HDMR+ASGC 
methods  terminated  at  Q  =  924  and  Q  =  541  samples,  respec¬ 
tively.  In  comparison  to  Figure  9,  Figure  13  clearly  reveals  that 
the  sparse  grid  methods’  performances  worsen  with  increased 
x0bs,  and  they  become  comparably  accurate  as  the  Sobol  and 
Halton  sequences.  This  is  mainly  due  to  increased  uncertainty 
with  more  interaction  of  waves  with  uncertain  media.  On  the 
other  hand,  the  MC  sampling  applied  with  a  sample  size  similar 


Q  (#of  samples  used) 


Fig.  9.  Error  convergence  in  Example  1  of  Section  III-B. 


Fig.  10.  PF  estimates  for  Example  1,  |P[PF(100km,  z\  y)]  |,  corresponding 
to  the  convergence  results  in  Figure  9. 


to  that  of  the  depicted  sparse  grids  (Q  =  1, 000)  revealed  2.8  dB 
and  1.8  dB  reception  discrepancies  at  100  meters  and  200  meters 
elevations,  respectively.  However  the  h—GSG  solution  with 
Q  =  924  samples,  and  HDMR+ASGC  solution  with  Q  =  541 
samples  very  accurately  matched  the  reference  solution,  as 
depicted  in  Figure  14. 

Finally,  the  error  convergence  as  a  function  of  total  elapsed  time 
for  Example  1  is  depicted  in  Figure  15.  The  average  computa¬ 
tion  time  that  SSPE  solver  takes  to  evaluate  each  sample  was 
monitored  as  54  milliseconds,  running  on  a  computer  with  Intel 
Core  i7  3.4  GHz  processor  and  4GB  memory.  We  demonstrate 
this  only  with  MC  sampling,  but  the  QMC  methods  have  the 
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Fig.  12.  Field  estimates  for  Example  2,  | E[ip(  100km,  z\  y)]  |,  corresponding 
to  the  convergence  results  in  Figure  1 1 . 


same  computational  cost.  In  accordance  with  the  discussion 
on  time  in  Section  III-A,  comparison  between  Figures  9  and 
15  reveals  that  total  computation  time  is  dominated  by  the 
number  of  samples  the  SSPE  solver  evaluates.  Therefore,  the 
computational  cost  other  than  that  of  evaluating  the  samples  is 
minor.  As  the  deterministic  solver  gets  more  time  consuming, 
the  extra  cost  incurred  in  sparse  grids  will  be  relatively  less 
significant. 


Fig.  13.  Error  convergence  in  Example  3  of  Section  III-B. 


Fig.  14.  Field  estimates  for  Example  3,  |P[PF(150km,  z;  y)\  |,  corresponding 
to  the  convergence  results  in  Figure  13. 


IV.  Conclusions 

We  have  considered  two  canonical  examples  for  assessing 
the  strength  of  the  sparse  grid  methods  in  electromagnetic 
propagation  environments.  For  the  interface  of  dimensionality 
reduction  method  (HDMR)  with  the  adaptive  SGC  (ASGC), 
HDMR+ASGC,  we  have  introduced  and  used  Comp  Admit, 
which  has  a  less  conservative  “component  admission”  rule  than 
the  original  rule  given  in  [29].  For  h— GSG  method,  we  have 
followed  [32]. 

The  first  application,  reflection  from  K— Slabs  is  a  1-D  scat- 
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Fig.  15.  Error  convergence  for  MC  sampling,  h— GSG  and  HDMR+ASGC  as 
a  function  of  total  elapsed  time  in  seconds,  for  Example  1. 


tering  problem.  Through  this  application  we  tested  the  SGC 
methods’  performance  with  increasing  dimensionality  and  sta¬ 
tistical  variation.  The  100— dimensional  example  in  Section 
III- A  revealed  strength  of  the  h— GSG  for  problems  where 
randomness  is  cast  along  certain  axes  of  the  random  space. 

In  Section  III-B,  we  considered  a  more  realistic  propagation 
problem  with  uncertainty,  where  randomness  is  represented  in 
d  =  5  RVs  that  constitute  uncertain  ducting  phenomena  in 
the  lower  troposphere.  The  RVs  are  extracted  from  published 
measured  data,  and  represents  randomness  observed  during  a 
season-long  atmospheric  monitoring  [46].  We  have  showed 
that  both  HDMR+ASGC  and  h— GSG  offered  much  steeper 
convergence  than  the  MC  sampling  and  QMC  methods  in 
this  problem.  The  advantage  of  using  sparse  grids  were  more 
significant  in  the  case  where  the  target  function  is  the  complex 
field,  than  is  the  PF  (normalized  power).  The  sparse  grids 
have  proven  better  convergence  than  MC  sampling  and  QMC 
methods  up  to  150  km  range. 

Another  application  that  is  common  in  long-range  propagation 
phenomena  is  the  scattering  from  rough  surfaces.  A  forward 
scattering  approach  in  computing  PF  far  from  the  transmitter 
location,  whereas  the  randomness  is  in  the  generation  of  the 
randomly  shaped  perfectly  conducting  (PEC)  surface,  has  con¬ 
ventionally  been  tackled  with  MC  sampling  [61],  [63].  We  have 
considered  this  application  with  sparse  grids  in  [64].  There,  due 
to  highly  non- smooth  behavior  in  the  random  space  and  high— d 
feature  of  existing  random  surface  generation  tools,  the  sparse 
grid  performances  are  poorer  than  that  of  QMC  methods  in 
general. 
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Abstract — By  considering  the  2D  problem  of  electrical  line 
sources  radiating  in  the  presence  of  perfectly  conducting  cylinders 
and  decomposing  the  real  power  flow  on  a  circumscribing  obser¬ 
vation  circle  separating  the  transmit  nodes  from  the  receive  nodes, 
simple  formulas  are  derived  for  the  electromagnetic  degrees  of 
freedom  in  scattering  environments  for  a  network  of  nodes  com¬ 
municating  with  each  other.  The  locations,  magnitudes,  and  phases 
of  the  line  sources  are  assumed  to  be  independent  and  identically 
distributed  (i.i.d.)  random  variables.  Similarly,  the  locations  of  the 
scatterers  in  the  region  outside  the  observation  circle  are  assumed 
to  be  i.i.d.  random  variables.  The  exact  scattering  problem  is  cast 
in  the  form  of  an  integral  equation,  where  the  Fourier  coefficients 
of  the  scatter  current  density  are  the  unknowns.  Based  on  the 
Born  approximation  that  is  valid  for  mild  scatter  densities  and 
asymptotic  analysis,  a  closed  form  expression  is  derived  for  the 
number  of  degrees  of  freedom  in  scattering  environments.  The 
benefit  of  observing  near-fields  in  the  determination  of  degrees 
of  freedom  is  included  in  the  numerical  examples  considered.  If 
the  power  per  source  and/or  the  number  of  sources  within  the 
circumscribing  circle  are  made  to  increase  algebraically  with  the 
size  of  the  circle,  it  is  shown  that  scattering  environments  can 
offer  much  higher  degrees  of  freedom  than  what  are  available  in 
free-space. 

Index  Terms — Born  approximation,  electromagnetic  degrees  of 
freedom,  electromagnetic  scattering,  integral  equations,  random 
discrete  scatterers. 


I.  Introduction 

OVER  the  last  few  decades,  wireless  systems  have  per¬ 
vaded  many  areas  including  consumer  electronics,  mili¬ 
tary  electronics  systems,  electronic  health  systems,  navigational 
systems,  imaging  systems,  electro-optical  systems  etc.,  to  name 
a  few.  In  the  area  of  wireless  communications,  the  focus  has 
been  shifting  steadily  from  a  point-point  based  system  to  sys¬ 
tems  comprised  of  distributed,  communicating  nodes.  AdHoc 
[1],  body  area  [2],  [3],  and  cognitive  wireless  networks  [4]  have 
thus  evolved  over  the  last  few  years.  In  the  efficient  design  of 
many  of  these  systems,  it  becomes  imperative  to  understand  the 
intrinsic  limits  set  by  the  sizes  of  radiating  and  receiving  vol¬ 
umes,  distribution  of  nodes  and  the  architecture  of  system  in  the 
case  of  wireless  networks,  the  electromagnetic  environment  in 
which  the  systems  operate,  the  inevitable  noise  present  in  the 
detecting  systems,  etc.  This  leads  one  to  the  notion  of  degrees 
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of  freedom  (DOF),  whose  study  has  been  undertaken  by  many 
researchers  in  the  past.  Qualitatively,  the  number  of  independent 
parameters  needed  to  represent  the  output  field  or  signal  within 
a  given  precision  is  known  as  DOF. 

One  of  the  earliest  investigations  on  the  degrees  of  freedom 
was  carried  out  by  Toraldo  di  Francia  [5],  who  showed  that  the 
number  of  degrees  of  freedom  (NDOF)  that  are  available  in  an 
optical  image  formed  by  any  real  instrument  is  finite  even  if  that 
contained  in  the  object  is  infinite;  further  the  NDOF  along  each 
spatial  direction  for  monochromatic  or  incoherent  images  de¬ 
tected  by  far- field  receivers  subject  to  limited  aperture  is  pro¬ 
portional  to  the  product  of  the  numerical  aperture  and  the  spatial 
extent  of  the  object,  a  result  that  is  known  as  diffraction  limit  in 
optics.  The  spatial  bandwidth  of  scattered  electromagnetic  fields 
introduced  by  Bucci  and  Franceschetti  [6]  is  proportional  to  the 
DOF.  In  a  series  of  papers  [7],  [8],  Bucci  and  coworkers  showed 
that  the  electromagnetic  field  radiated  or  scattered  by  bounded 
sources  can  be  represented  over  a  substantially  arbitrary  surface 
by  a  finite  number  of  samples  even  when  the  observation  do¬ 
main  is  unbounded.  Treating  the  optical  system  as  a  communi¬ 
cation  system  where  electromagnetic  waves  communicate  in  a 
three-dimensional  space,  Piestun  and  Miller  [9]  and  Miller  [10] 
showed  that  the  optimum  transmitting  and  receiving  functions 
and  the  NDOF  are  solutions  of  well-defined  eigenvalue  equa¬ 
tions. 

With  the  advent  of  multiple-input  multiple-output  (MIMO) 
wireless  communication  systems  [11],  [12],  there  has  been  a 
renewed  interest  in  the  notion  of  DOF.  The  issue  of  interest 
there  is  how  the  system  capacity  scales  under  rich  multipath 
scattering  with  the  number  of  elements  under  a  variety  of  con¬ 
straints:  fixed  transmitting  and  receiving  volumes,  fixed  amount 
of  scattering,  fixed  signal  to  noise  ratio  (SNR),  fixed  transmit 
power,  etc.  The  answer  to  these  questions  is  intimately  tied  to 
the  available  NDOF  of  the  MIMO  system  and  has  been  studied 
by  a  number  of  authors.  Poon,  et  al.  [13],  [14]  evaluated  the 
effective  degees  of  freedom  (EDOF)  for  clustered  scattering  en¬ 
vironments,  where  the  space  between  the  transmit  array  and 
receive  array  of  a  MIMO  system  is  partially  filled  with  scat¬ 
tering  clusters.  They  showed  that  the  number  of  spatial  degrees 
of  freedom  is  equal  to  the  product  of  angular  spread  as  seen 
from  a  far-zone  receive  array  and  the  electrical  size  of  the  array; 
a  result  reminiscent  of  the  earlier  result  obtained  by  Toraldo  di 
Francia.  Migliore  [15]  related  these  EDOF  to  the  NDOF  of  the 
electromagnetic  field  itself.  Using  a  plane- wave  representation 
of  receiving  multipath  fields,  Kennedy,  et  al.  [16]  show  the  fa¬ 
miliar  result  that  the  degrees  of  freedom  in  2-D  spatial  regions  is 
linearly  proportional  to  the  size  of  the  circle  that  circumscribes 
the  receive  array.  In  order  to  study  the  dependence  of  the  DOF 
on  the  amount  of  scattering  present,  Xu  and  Janaswamy  [17] 
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studied  the  full- wave  electromagnetic  problem  having  fixed  size 
transmit  and  receive  antennas  in  the  presence  of  an  intervening 
scatter  cluster.  Their  simulation  results  indicate  that  the  DOF 
number  generally  increases  with  both  the  transmit  volume  and 
the  receive  volume  before  it  saturates.  The  scattering  environ¬ 
ment  together  with  the  sizes  of  the  transmit  and  receive  antenna 
volumes  were  shown  to  be  the  key  factors  that  influence  the  DOF 
number. 

In  wireless  networks,  it  is  of  interest  to  know  how  the  system 
throughput  scales  with  the  number  of  nodes  N{  as  Ni  — »  oo 
[18],  [19].  A  number  of  studies  have  been  conducted  lately  in 
this  regard  [20]-[23].  Ozgur,  et  al.  considered  both  dense  net¬ 
works  (node  density  increases  with  the  number  of  nodes)  and 
extended  networks  (coverage  area  increases  with  the  number  of 
nodes)  and  obtained  scaling  law  results  for  information-theo¬ 
retic  capacity  by  considering  a  particular  fading  model  and  a 
non-free- space  path  loss  model.  Their  results  were  built  upon 
those  of  Xie  and  Kumar  [20],  [21]  and  Xue  and  Kumar  [24]. 
However,  Franceschetti  et  al.  [23]  considered  an  extended  wire¬ 
less  network  with  Ni  users  located  within  a  ball  of  radius  pro¬ 
portional  to  s/Ni  and  communicating  with  an  equal  number 
of  exterior  users.  They  showed  that  the  capacity  scaling  for 
Ni  — >  oo  is  subject  to  a  fundamental  limitation  that  is  indepen¬ 
dent  of  power  attenuation  and  fading  models;  instead,  it  was  the 
electromagnetic  degrees  of  freedom  that  determine  the  scaling 
laws. 

Subsequent  research  [25]  has  also  recognized  the  importance 
of  NDOF  in  determining  the  throughput  capacity  of  wireless 
networks.  It  is  clear  from  [26]  that  the  degrees  of  freedom  also 
play  a  central  role  in  determining  the  capacity  of  cognitive  net¬ 
works.  What  is  not  clear  from  many  of  these  later  studies  is 
whether  the  degrees  of  freedom,  as  measured  by  the  significant 
number  of  modes  present  on  a  closed  observation  surface  sepa¬ 
rating  the  transmit  nodes  from  the  receive  ones,  depend  on  scat¬ 
tered  present  outside  it.  The  asymptotic  studies  carried  out  in 
[23]  for  Ni  — >  oo  assume  that  they  do  not.  While,  the  asymp¬ 
totic  results  of  [20]  and  [23]  yield  the  order  magnitude  behavior 
for  the  DOF,  they  are  not  very  useful  when  applied  to  the  prac¬ 
tical  case  of  small  sized  networks.  Further,  they  shed  no  light 
on  the  proportionality  constant,  which  could  be  an  important 
parameter  in  an  actual  system  design.  There  is  reason  to  believe 
that  external  scatterers,  acting  as  secondary  sources  of  radiation 
and  causing  back-scattering,  can  redistribute  power  in  the  avail¬ 
able  modes  and  consequently  change  the  NDOF.  Furthermore, 
the  benefits  provided  by  observing  the  near-fields  [27]  must  be 
included  in  any  estimation  of  the  degrees  of  freedom. 

The  main  purpose  of  the  present  paper  is  to  examine  whether 
scatterers  external  to  the  closed  observation  surface  separating 
the  transmit  and  receive  nodes  play  any  role  in  the  determina¬ 
tion  of  the  degrees  of  freedom.  We  demonstrate  by  considering 
2D  situation  with  line  sources  and  perfectly  conducting  circular 
cylinders  that  external  scatterers  actually  provide  opportunities 
for  significantly  increasing  the  NDOF  over  what  are  possible 
in  free-space.  The  electrical  size  of  the  problem  for  conducting 
the  initial  exact  numerical  studies  to  validate  the  Born  approx¬ 
imation  employed  later  in  the  paper  is  chosen  based  on  com¬ 
putational  constraints  and  may/may-not  necessarily  correspond 
to  a  physical  wireless  network.  Nevertheless,  despite  this  short- 


Fig.  1.  Sources  randomly  located  within  an  circle  of  radius  r  <  i?m  and 
scatterers  located  in  the  annular  region  Rp  <  r  <  R0.  The  buffer  layer 
Rm  <  r  <  Rp  is  of  fixed  thickness  A  <C  b  and  is  free  of  scatterers  and 
sources.  The  observation  circle  has  radius  b  —  {R.ni  +  Rp)/2  ft;  Rm. 

coming,  we  believe  that  the  role  of  external  scatterers  as  delin¬ 
eated  in  the  present  paper  and  the  Born-approximation  analyt¬ 
ical  results  presented  do  carry-over  to  an  actual  network.  It  may 
be  noted  that  the  scatterers  present  inside  the  surface  need  not 
be  accounted  for  separately  as  they  are  equivalent  to  secondary 
interior  sources  that  behave  similar  to  primary  interior  sources. 
The  connection  between  the  NDOF  and  the  wireless  system  ca¬ 
pacity  is  established  in  a  number  of  works  (see  [23]  and  [22], 
for  example)  and  will  not  be  pursued  here. 

II.  Theory 

Fig.  1  shows  Ni  electric  current  sources  (will  also  be  referred 
to  as  nodes  or  users)  randomly  distributed  within  a  circular  re¬ 
gion  of  radius  jRm.  The  usual  cylindrical  coordinates  (r,  z)  are 
employed  in  the  paper,  where  r  =  (r,  </>)  denotes  the  polar  coor¬ 
dinates  in  the  plane.  It  is  assumed  that  these  nodes  are  communi¬ 
cating  with  some  exterior  nodes  and  the  wireless  links  between 
them  intersect  the  imaginary  surface  r  =  b  >  i2m.  Together, 
all  of  these  nodes  constitute  a  wireless  network.  One  of  the  key 
system  performance  metrics  is  the  network  throughput  capacity 
between  the  interior  and  exterior  cluster  of  users,  which  depends 
on  the  NDOF  observed  on  the  surface  r  =  b  [23]. 

The  magnitude  an  and  the  phase  /3n,  n  =  1,  2, . . . ,  Ni  of  the 
individual  node  source  currents  In  =  ane^n  are  assumed  to 
be  independent  and  identically  distributed  random  variables.  In 
particular,  we  assume  that  (3n  are  uniformly  distributed  in  the 
range  (0, 27r)  and  that  the  magnitudes  are  restricted  by  (ck|)  = 
2P0/r]o ,  where  angle  brackets  denote  expectation,  770  is  the  in¬ 
trinsic  impedance  of  free-space,  and  PQ  is  the  power  per  node. 
Upper  bounding  the  mean  square  current  magnitude  of  these  in¬ 
dividual  line  sources  automatically  prevents  the  excitation  of  an¬ 
tenna  superdirectivity,  an  issue  whose  importance  was  also  un¬ 
derscored  in  the  studies  of  [28]  and  [23].  Perfectly  conducting 
scatterers,  each  of  radius  a  and  Q  in  number,  are  assumed  to 
be  randomly  located  in  the  annular  region  Rp  <  r  <  R0.  A 
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thin  buffer  layer  R m  <  r  <  Rp  of  vanishing  thickness  ex¬ 
cludes  sources  and  scatterers.  The  fields  are  observed  on  the 
circle  with  radius  b  =  (. Rp  +  jRm)/2  «  Rm  within  this  buffer 
layer.  The  scatterers  are  assumed  to  be  uniformly  distributed  is 
space  and  their  locations  are  assumed  independent  of  each  other. 
The  fractional  area  density  of  scatterers,  pa,  is  given  by  pa  = 
Qa? /(R2  —  R2).  The  assumptions  on  independent  scatter  po¬ 
sition  make  sense  provided  that  the  area  density  is  low  enough. 
Otherwise  the  statistics  will  be  governed  by  the  pair-distribution 
functions  [29],  [30]. 

The  observation  circle  r  =  b  corresponds  to  the  cut-set  or 
simply  the  cut  that  divides  the  communicating  region  into  two 
parts — the  source  region  and  the  destination  region.  According 
to  the  Max-Flow-Min-Cut  bound  theorem  [31],  [20],  the  total 
rates  achievable  from  the  nodes  in  the  source  set  to  those  in  the 
destination  set  depends  on  the  mutual  information  or  distribu¬ 
tion  of  power  observed  on  the  cut.  This  result  has  been  used 
in  [23]  in  determining  the  degrees  of  freedom  and  we  will  also 
determine  the  degrees  of  freedom  by  observing  the  power  flow 
on  the  cut.  As  stated  previously,  it  is  not  necessary  to  include 
scatterers  in  the  region  r  <  Rm  as  these  will  tantamount  to  sec¬ 
ondary  sources  whose  influence  on  NDOF  will  be  the  same  as 
the  primary  source  currents. 

The  assumed  sources  generate  a  TM^  wave  comprised  of  the 
field  ( Ez ,  Hr ,  Hcp).  We  will  be  concerned  with  the  normal  com¬ 
ponent  of  the  Poynting  vector  on  the  observation  circle,  which 
will  depend  only  on  the  field  components  (EZ,H^)\  we  will 
consequently  relabel  these  as  simply  (. E ,  H ).  A  time  harmonic 
variation  of  the  form  e^r,  where  u  is  the  radian  frequency  and 
r  is  the  time  variable  is  assumed  of  all  source  and  field  quan¬ 
tities.  The  wavenumber  in  free-space  is  denoted  by  fco  and  the 
location  of  the  nth  source  is  denoted  by  rn  =  (rn,  <j)n).  The 
total  incident  field  ( Ei ,  Hi)  caused  by  all  of  the  interior  sources 
acting  in  free-space  is  given  by 

7  Ni 

Ei{v)  =  -^YjInH^\k0\v-vn\)  (1) 

n= 1 

where  H^}  (x)  is  the  Hankel  function  of  second  kind  of  order 
ra  and  argument  x.  Using  the  addition  theorem  for  Hankel  func¬ 
tions  [32],  the  incident  field  could  be  decomposed  in  terms  of 
orthogonal  modes  on  any  observation  circle  of  radius  r  >  Rm 
as 

,  Ni  oo 

^  =  E  H£\k0r)Jm(k0rnym^-^ 

n= 1  m=—oo 

(2) 

where  Jm(x)  is  the  Bessel  function  of  the  first  kind  of  order  ra 
and  argument  x.  The  magnetic  field  Hi  =  (jkof]o)~1dEi/dr  is 
similarly  given  by 

.7  Ni  oo 

Hi  =  lfYJIu  J2  H^\k0r)Jm(k0rn)e^-M 

n= 1  m=— oo 

(3) 

where  the  superscript  prime  denotes  differentiation  with  respect 
to  the  argument.  Each  term  with  a  fixed  ra  in  the  above  summa¬ 


tions  will  represent  an  orthogonal  mode,  in  terms  of  which  the 
fields  are  expanded.  The  mode  impedance  (ratio  of  the  mode 
electric  field  to  the  mode  magnetic  field)  for  the  interior  source 
is  a  complex  quantity  of  the  form  jrjoHm^  (&o r) /H$  {k$r)  ~ 
770,  as  r  oo.  The  real  part  of  the  average  power  flow  Pt  = 
$t(—EiH*),  [Watts/m2],  where  the  expectation  is  performed 
with  respect  to  all  random  variables  (locations,  magnitudes  and 
phases  of  sources),  dt(z)  denotes  the  real  part  of  and  su¬ 
perscript  *  denotes  complex  conjugation,  can  be  readily  ob¬ 
tained  by  using  the  Wronskian  property  of  the  Bessel  functions 
H$  (x)Jm(x)  -  H^n\x)J!m(x)  =  -2j /irx  [32],  the  expec¬ 
tation  result  =  6^,  where  6^  is  the  Kronecker’s 

delta,  and  the  identity  oo  J™(x)  =  as 

k0Po(b)  ^  /  t2  n  W 
=  2^  <4#orn)> 

n=  1  m=—c so 

=.  v  p*  =  tA\ 

■  A L  rm  Awb  ■  W 

m=  —  oo 

The  argument  b  is  included  in  PQ  to  indicate  the  possibility  that 
the  power  per  node  can  depend  on  the  radius  b  separating  the 
interior  sources  from  the  exterior  ones.  The  quantity  P ^  is  the 
power  carried  by  the  rath  mode  in  free-space  due  to  all  of  the 
interior  nodes  and  will  appear  later  in  the  asymptotic  analysis. 
As  expected,  Pt  decays  with  distance  in  free-space  as  0(1/6) 
when  P0(b)  is  a  constant. 

In  the  presence  of  scatterers,  we  express  the  total  field  as 
(E,H)  =  (. Ei,Hi )  +  (. ES,HS ),  where  the  scattered  field 
(ES,HS)  is  set  up  by  the  currents  Js  induced  on  the  surface  of 
the  scattering  objects.  For  the  TM^  polarization,  the  induced 
currents  are  in  the  ^-direction,  viz.,  Js  =  zJs.  The  scattered 
electric  field  is  related  to  the  surface  current  densities  through 
[33] 

Es{ r)  =  [  A( rq)42\k0\r  -  r,|)  dlq  (5) 

q=l2 

1  <3 

where  Tq  denotes  the  surface  of  the  qth  cylinder  and  rq  denotes 
a  point  on  it.  To  determine  the  surface  current  densities,  we  set 
up  an  electric  field  integral  equation  by  requiring  that  the  total 
field  on  the  pth  cylindrical  surface  be  identically  zero:  E( rp)  = 
Ei(rp)  +  Es(rp)  =  0 =  1, 2, . . . ,  Q.  For  circular  cylinders, 
it  is  convenient  to  expand  the  surface  currents  in  a  finite  Fourier 
series  of  the  form 

-it  K^ej^  (6) 

a  £=-L 

where  $q  denotes  the  polar  angle  on  the  qth  cylinder  with  respect 
to  a  coordinate  system  erected  at  its  center  and  [Amps], 
q—  1,  2, . . . ,  Q,  t  —  — L , . . . ,  L  are  the  unknown  current  coef¬ 
ficients  to  be  solved.  The  total  number  Lq  =  (2L  + 1)  of  Fourier 
modes  required  to  accurately  represent  the  current  on  a  cylinder 
depends  on  its  electrical  size  k$a.  For  a  circular  cylinder  excited 
by  a  plane  wave  or  a  line  source,  the  mode  coefficients  decay 
as  Ji(koa) / H^2\koa)  [33].  For  example,  with  k$a  =  0.1, 
\K^  /K^  |  1.42  x  10-2  and  it  may  be  sufficient  to  use  L  — 
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0.  A  good  rule  of  thumb  is  to  use  L  =  max(0,  [5koa  —  0.5]), 
where  [x]  denotes  nearest  integer  value  of  x.  If  the  coordinates 
of  the  observation  point  with  respect  to  the  center  of  the  gth 
cylinder  are  (rq,  £q),  substitution  of  (6)  in  (5)  together  with  the 
addition  theorem  for  Bessel  functions  results  in 


Utn  =  -Hf\k0Rnq)e-^«  (11) 

with  the  single  index 


Es  =  E  K^Mk0a)HP(k0Tq)e^.  (7) 

<7=1  £=-L 

To  set  up  the  integral  equation,  it  is  necessary  to  express  the  co¬ 
ordinates  (rq^q)  in  terms  of  the  centralized  coordinates  (r,  f) 
and  the  coordinates  of  the  center  of  each  cylinder.  To  accom¬ 
plish  this,  the  addition  theorem  is  once  again  invoked  for  the 
function  H^2\korq).  The  orthogonal  expansion  of  (6)  enables 
the  enforcement  of  the  boundary  condition  E  —  0  on  the  sur¬ 
face  of  each  cylinder  on  a  mode  by  mode  basis.  When  these  steps 
are  carried  out,  the  following  linear  equations  for  the  unknowns 
are  obtained: 

i^^OM  +  E  E  KeP) Mkoa)ej^-£'^ 

p= 1  £=-L 

P7^< 1 

x  H^e,(k0rpq) 

Ni 

=  -'£iInHW(k0Rnq)e-j*'1'V 

n=  1 

g=l,2,...,Q,  e  =  -L,...,L  (8) 


where  rpq  is  the  distance  between  the  centers  of  the  pth  and  gth 
cylinders,  (3qp  is  the  polar  angle  of  the  center  of  gth  cylinder 
with  respect  to  the  center  of  the  pth  cylinder,  Rnq  is  the  dis¬ 
tance  between  the  nth  line  source  and  the  center  of  the  qth 
cylinder,  and  7 nq  is  the  polar  angle  of  the  nth  line  source 
with  respect  to  the  center  of  the  gth  cylinder.  Equation  (8) 
is  a  system  of  Nu  =  LqQ  equations  for  the  Nu  unknowns 
Kf?\  The  first  term  on  the  left  hand  side  of  (8)  arises  from 
the  scattering  of  incident  waves  by  the  qth  cylinder  and  the 
double  summations  terms  arise  from  the  multiple  scattering 
of  waves  by  other  cylinders.  Equation  (8)  constitutes  what 
we  call  as  the  full-wave  case  and  determination  of  the  un¬ 
knowns  will  involve  inverting  an  Nu  x  Nu  matrix.  Denoting 


K  _  rz^C1)  /rC1)  KKZ)  K{Z)  K 

. ,  K^]x,  where  the  superscript  ‘t’  denotes 
matrix  transpose,  V  =  . . 


(!)  frK2)  fcK2) 


K2) 

L  ’  *  *  ‘  ’ 


T/(2)  T f(Q)  T AQ) 

•  •  •  ’  v L  $  •  •  •  ?  V-L  >  V -L+ 1 


, . . . ,  V^]1,  where 


yi1)  y( 2)  y(2) 

1  V  L  iV-LiV-L+ 1? 


Ni 


V£{q)  =  -Y/InHl)(k0Rnq) 


-ihn 


(9) 


n=  1 


Equation  (8)  can  be  cast  in  the  form  of  a  matrix  equation 


K  =  YV  (10) 

where  the  elements  of  the  admittance  matrix  Y  will  only  de¬ 
pend  on  the  location  and  electrical  size  of  the  scatterers,  and  the 
order  £  of  the  current  expansion.  For  subsequent  analysis,  it  is 
convenient  to  express  the  quantity  V  as  V  =  UI,  where  the 
matrix  element  of  U  is 


t  —  qLo  —  L  +  £.  t  —  1,2,...,  Nu  (12) 


taking  the  place  of  the  pair  (g,  £)  and  I  =  [/1, 12, . . . ,  InX  is 
the  vector  of  source  currents. 

When  the  density  of  scatterers  pa  is  low  enough,  the  multiple 
scattering  terms  in  (8)  can  be  ignored  and  an  explicit  solution 
for  the  unknowns  is  possible: 


K(q) 

JX£ 


Ni 


H?\k0a)  ^ 


(13) 


This  is  known  as  the  Born  approximation  [34]  and  is  extremely 
useful  in  getting  physical  insight  into  the  role  of  various  scat¬ 
tering  parameters  as  will  be  demonstrated  shortly.  If,  in  addi¬ 
tion,  the  cylinders  are  electrically  small  (k$a  1),  only  the 
£  =  0  term  is  significant. 

If  the  coordinates  of  the  center  of  the  gth  cylinder  are  denoted 
by  (pq,  0q),  the  scattered  fields  at  any  point  r  =  (r  <  ;/Y/,</>), 
after  a  recourse  to  the  addition  theorem,  are  given  by 

Es( r)  =  Z^E  E 

<7=1  £=-L 
00 

X  E  Hln-e(koiiq)Jm(kor)ejm^-^ 

m=— 00 

(14) 

Hs( r)  =  ^E  E  K^e^Mkoa) 

q=l£=-L 

00 

E  H^koaMkory^-^  (15) 


It  is  seen  that  for  the  exterior  (actual  or  induced)  sources,  the 
mode  impedance  E^/Hi^  is  jrjoJm(kor)  /  J^k^r),  which  is 
always  purely  imaginary.  The  induced  sources  due  to  exterior 
scatterers  will  not  contribute  to  real  power  flow  on  the  obser¬ 
vation  circle  r  =  b.  But  the  interference  of  incident  and  scat¬ 
tered  fields  can  contribute  to  real  power  flow  as  the  next  section 
shows. 


A.  Power  Flow  in  Orthogonal  Modes 

In  [28]  and  [23],  the  authors  performed  a  singular  value  de¬ 
composition  of  the  fields  on  the  observation  surface  assuming 
volume  current  densities  of  sources  that  belong  to  the  £2  (square 
integrable  function)  space.  However,  as  shown  in  [35],  [36],  re¬ 
quiring  the  field  intensities  to  belong  to  the  £2  space  (so  that 
energy  in  a  finite  space  is  finite)  does  not  imply  that  the  cur¬ 
rent  densities  belong  to  this  space.  Simple  counter  examples  are 
singular  point  sources  and  surface  current  densities  on  perfectly 
conducting  surfaces.  Instead,  we  will  look  at  the  real  power  car¬ 
ried  by  orthogonal  modes  on  the  observational  surface,  which 
will  then  take  the  place  of  singular  values  in  the  study  of  [23]. 
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Even  though  real  part  of  Poynting  vector  is  used  here,  the  impor¬ 
tant  contribution  of  near  fields  is  manifest  through  the  inherent 
coupling  present  between  the  incident  and  scattered  fields.  The 
power,  Pm,  carried  by  the  mth  orthogonal  mode  on  the  obser¬ 
vation  circle  r  =  b  is  defined  as  3t[(— (&))],  where 
(Pm,  Hm)  is  the  total  field  contained  in  the  mth  mode.  The  in¬ 
cident  and  scattered  fields  in  the  mth  mode  are  given  in  (2),  (3) 
and  (14),  (15).  As  already  indicated  in  (4),  the  contribution  of 
the  line  sources  in  free- space  to  Pm  is  denoted  by  P^  and  equals 

Pl  =  Pt{J2m{k0rn)).  (16) 


i-»E 

£=-L 


QJt  (&o&) 
HP\k0a) 


(19) 


As  expected,  the  Born  approximation  result  (19)  is  independent 
of  the  scatterer  azimuthal  position  0q.  If,  in  addition  to  mild 
scattering,  the  scatterer  radius  k^a  1,  then  only  the  £  =  0 
Fourier  mode  on  the  scatterer  is  significant  and  one  gets  the 
simpler  expression 


Using  (14)  and  (15)  for  the  scattered  fields  and  carrying  out 
some  algebraic  manipulations,  the  power  Pm  can  be  expressed 
as 


1_R[  QMkoo) 

\H£\koa) 


Q 


N; 


q=t  £=—L  n= 1 

xe-^Je(koa)Jm(k0rn)H^_e(ko^q)) .  (17) 


As  stated  in  the  previous  subsection,  the  scattered  fields  alone 
yield  reactive  power  on  the  circle  r  —  b  and  do  not  contribute  to 
Pm.  The  additional  terms  contained  in  (17)  are  due  to  the  inter¬ 
action  of  the  scattered  field  with  the  incident  field  and  depend  on 
the  non-zero  correlation  between  the  source  currents  In  and  the 
induced  scattering  currents  K^q\  If  the  induced  currents  K ^ 
were  replaced  with  primary  source  currents  I^\k  =  1,  2, ... , 
of  exterior  users  that  are  statistically  uncorrelated  to  In,  one 
would  get  a  value  of  zero,  as  expected,  for  the  additional  terms 
in  (17),  resulting  in  Pm  =  PP  Hence  uncorrelated  exterior 
sources  do  not  contribute  to  the  power  flow  on  the  observation 
surface. 

Averages  with  respect  to  the  fluctuations  in  the  source  cur¬ 
rents  in  (17)  can  be  performed  by  invoking  (10).  Carrying  out 
the  expectations  with  respect  to  the  magnitude,  phase  and  lo¬ 
cation  of  source  currents  and  simplifying,  the  following  exact 
expression  is  obtained  for  the  power  carried  by  the  mth  mode 
on  r  =  b\ 


P  —  Pl 

1  m,  -  1  m 


^EE*^. 


a*  j[(m-£)6q-(m-£')0q/] 


The  averages  present  in  (16)  and  (19)  can  be  evaluated  in  a 
closed  form  for  a  uniform  distribution  of  sources  and  scatterers. 
The  probability  density  function  in  the  radial  position  for  a  uni¬ 
form  distribution  of  a  point  in  the  annular  region  n  <  r  <  r2  is 
p(r)  =  2'kv/A,  where  A  =  7r( r \  —  r\)  is  the  area  of  the  annular 
region.  The  averages  can  be  evaluated  using  the  identity  [37] 


27T 

~A  „ 

j  r^m(r)  dr 

(21) 

7 TV2 

A 

[zm(r)  -  2m-i(r)2m+i(r)] 

(22) 

where  Zm(r)  is  any  integer  ordered  Bessel  function. 

B.  Asymptotic  Analysis 

Expressions  (20),  (19),  and  (18)  are  valid  for  any  order  m.  To 
estimate  the  DOFs  in  free-space  and  in  scattering  environments 
and  for  effectively  evaluating  these  expressions  for  large  m,  it 
is  necessary,  however,  to  carry  out  an  asymptotic  analysis  valid 
for  large  m.  For  fixed  argument  and  large  orders  with  m  >  z, 
we  employ  the  following  asymptotic  formulas  for  the  Bessel 
functions  [32] 


x  Je(k0a)Hjy^(ko»q)Hjy_j,  ( )) 


(18)  Using  these  in  (16),  (20),  and  (21)  we  get 


where  the  indices  t  and  t'  are  defined  as  in  (12).  Thus  the  power 
Pm  depends  in  a  highly  non-linear  fashion  on  the  source  and 
scatter  coordinates.  Also,  the  exact  solution  needs  the  inversion 
of  the  linear  equations  given  in  (8)  to  obtain  the  admittance  ma¬ 
trix  Y. 

Under  the  Born  approximation,  it  is  clear  from  (13)  that 
Ytt>  =  b\,  / H^2\koa),  a  result  that  is  independent  of  the 
scatterer  q.  Furthermore,  because  the  position  distribution  of 
all  scatterers  is  assumed  identical,  the  averaging  in  (18)  needs 
to  done  only  for  one  typical  cylinder.  In  that  case  one  gets 
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where  x\  —  koRm,X2  =  koRp,xs  =  koR0,As  =  tt(x^  —  x^). 
It  is  clear  from  (25)  that  for  large  m,  the  power  carried  by  the 
mth  mode  in  free-space  decays  faster  than  any  exponential.  For 
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Fig.  2.  Power  contained  in  the  orthogonal  modes  versus  mode  number. 


electrically  small  scatterers  operating  under  low  scatter  density 
(i.e.,  under  the  Born  approximation),  (20)  and  (26)  give 


PtlPa 


(7rmkoa)2(m2  —  1) 

PtlPa 


Pm 

Rn 


2m 


ra  >  X3 


(■ 7rm2koa ) 


2  ’ 


m  >  x  3 


(27) 


where  we  have  assumed  in  the  latter  that  x%  1,  «  1, 

and  set  7  =  J^k^a) /\H^\koa)\2 .  Hence  in  the  presence  of 
scatterers,  it  is  seen  that  the  higher-order  mode  power  decays 
only  algebraically.  This  will  have  a  direct  bearing  on  the  NDOF 
as  we  will  see  shortly. 

The  NDOF  is  defined  as  the  smallest  number  of  modes  M 
such  that  the  power  Pe  contained  in  the  tail  from  [M  +  1,  oo) 
is  a  small  fraction  of  the  total  power  Pt  contained  in  all  of  the 
modes.  Such  a  self -referral  definition  for  NDOF  avoids  direct 
comparison  of  received  power  with  noise  and  yields  the  same 
value,  irrespective  of  pathloss,  at  any  range  r  >  b,  as  long  as 
the  fractional  power  is  kept  constant  above  some  threshold.  Of 
course  the  threshold  chosen  will  depend  on  noise  power.  The 
power  contained  in  the  tail  in  free-space,  P\,  and  in  the  presence 
of  scattering,  Pe,  can  be  evaluated  in  a  closed  form  using  (25) 
and  (27)  and  are  obtained  as 


p>  —  2  V  Pl  <  _ - _ 

oo 

Pe  =  2  Y,  Pm 


mq\2(m+1) 


M+l 


^  2PtlPa  f  2  \2  / Mo 
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(29) 


where  the  factor  of  2  is  included  to  add  the  contribution  from 
negative  indices,  is  the  polygamma  function  [32],  and 

M0  =  \ekob/2]  ~  \ekoRm/2] .  The  inequality  in  (28)  follows 
from  the  fact  that  [38] 
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(30) 


It  is  seen  that  the  fractional  power  contained  in  the  tail  of  the 
orthogonal  modes  decays  faster  than  any  exponential  in  free- 
space,  but  only  algebraically  in  the  presence  of  scattering.  Also, 
under  Born  approximation,  the  power  Pe  is  linearly  proportional 
to  the  area  density  pa  of  scatterers.  The  power  Pt  is  propor¬ 
tional  to  the  product  of  Ni  and  PQ  (see  (4))  and  will  grow  at 
least  quadratically  with  M0  for  an  extended  network.  For  a  given 
error  power  density  Pe,  (29)  may  be  inverted  to  yield  an  expres¬ 
sion  for  the  degrees  of  freedom  M 
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where  we  have  changed  the  argument  of  PQ  from  b  to  M0  and 
added  the  argument  to  Ni  to  indicate  the  possibility  that  the 
number  of  nodes  can  increase  with  the  size  M0  of  the  observa¬ 
tion  circle.  Hence  if  the  product  P0(M0)Ni(M0 )  can  be  made 
to  increase  at  least  quadratically  with  M0,  there  is  a  poten¬ 
tial  for  increasing  M  enormously  relative  to  what  is  offered  in 
free-space.  This  has  positive  implications  in  wireless  network 
design  provided  that  one  can  successfully  address  the  simulta¬ 
neous  issue  of  higher  adjacent  node  interference. 


III.  Numerical  Results 

We  first  establish  the  validity  of  Born  approximation  (labelled 
‘BA’  in  the  figures)  for  mild  scatter  densities.  The  exact  inte¬ 
gral  equation  (labelled  ‘FW’  for  full- wave  in  the  figures)  will 
require  the  solution  of  an  Nu  x  Nu  matrix  per  realization.  The 
number  of  realizations,  Nr ,  and  the  problem  sizes  are  chosen 
modestly  so  as  not  to  inundate  the  computational  resources. 
Thus,  the  relatively  small  areas  chosen  for  the  purpose  of  cal¬ 
culating  the  exact  results  should  not  detract  the  reader  in  the 
usefulness  of  the  Born  approximation  approach.  In  Fig.  2,  we 
show  comparison  between  the  exact  integral  equation  solution, 
as  per  (18),  and  that  by  the  Bom  approximation,  as  per  (20),  for 
k0a  =  0.1,  X\  =  koRm  =  10.1,  x<i  —  10.5,  x$  —  14.5,  Ni  = 
81,  Q  =  100,  L  =  0,  Nu  =  100,  pa  =  1%  and  Nr  =  50.  Be¬ 
cause  the  scatter  sizes  are  electrically  small,  it  was  found  that 
convergent  solution  was  obtained  with  L  —  0  itself.  The  power 
contained  in  the  rath  mode  is  plotted  against  the  mode  number 
normalized  to  M0  =  \exi/2]  =  14.  For  comparison,  the  power 
in  free-space  is  also  shown.  It  is  seen  that  the  Born  approxima¬ 
tion  accurately  captures  the  proper  slopes  of  Pm  with  ra  both 
for  ra  <  M0  and  for  ra  >  M0 .  The  high-frequency  oscillations 
seen  in  the  exact  solution  is  due  to  the  inadequacy  of  the  number 
of  realizations  ( Nr  =  50)  used  for  averaging  and  can  be  elimi¬ 
nated  by  using  a  significantly  larger  number. 

Fig.  3  shows  the  comparison  for  larger  scatterers  with  k^a  = 
O.Itt.  The  current  density  on  each  cylinder  was  expanded  using 
5  modes  (L  =  2)  as  well  as  using  3  modes  (L  =  1).  Very  little 
difference  in  the  results  was  found  between  the  two  choices. 
Also,  larger  domain  size  with  x\  —  16.57T,  x%  =  23.57T  which 
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result  in  larger  number  of  source  currents  Ni  =  137  and  scat¬ 
tered  (Q  =  137)  have  been  considered.  The  exact  solution  in¬ 
volving  Nu  =  685  unknowns  for  each  realization  took  19  hours 
on  a  laptop  using  MATLAB  and  is  compared  with  the  Born  ap¬ 
proximation  that  uses  L  —  0.  The  exact  solution  requires  the 
inversion  of  a  685  x  685  complex-valued  matrix  for  each  re¬ 
alization  followed  by  m  x  Nu  matrix  multiplications  for  each 
summation  sign  in  (18).  There  were  a  total  of  270  values  of  m 
for  which  Pm  was  computed  in  Fig.  3.  Once  again,  it  is  seen 
that  the  Bom  approximation  reasonably  models  the  mode  power 
both  for  m  <  M0  and  m  >  M0. 

The  direct  expression  contained  in  (20)  is  not  suitable  for  an 
accurate  evaluation  for  large  ra,  because  it  would  involve  the 
difference  of  extremely  large  numbers  that  are  close  to  each 
other.  The  asymptotic  expressions  available  in  (25)  and  (27)  are 
more  suitable  for  that  purpose.  Fig.  4  shows  the  appropriate¬ 
ness  of  the  asymptotic  expressions  for  large  m.  The  parame¬ 
ters  used  in  the  computation  are  k^a  =  0.1,  x i  =  100,  x 3  = 


Fig.  5.  Mode  power  for  scatterers  distributed  uniformly  on  a  ring  of  radius 

Rc  >  RP- 


119.5,  M0  =  136,  Ni  =  796,  and  pa  =  0.05%.  The  direct  ex¬ 
pression  (19)  involves  Hankel  functions  of  order  exceeding  250 
for  argument  of  around  100  and  diverge  beyond  m  >  2 .6M0  ~ 
354.  However,  the  asymptotic  expression  (labelled  ‘BA-Asymp’ 
in  the  figure)  remain  valid  for  any  large  m>  N0  —  f erc3  / 2~|  ~ 
1.2 M0  and  get  better  as  m  — ►  00,  as  can  be  clearly  seen  from  the 
figure.  Of  course  the  asymptotic  formula  is  not  valid  for  smaller 
values  of  m  as  is  also  evident  from  the  figure. 

The  rapid  decay  of  higher  order  mode  power  observed  in 
free-space  is  halted  when  scatterers  are  present.  This  is  partic¬ 
ularly  true  when  the  power  is  observed  in  the  reactive  region 
of  scattered  fields.  To  appreciate  this  point  better,  we  consider 
scatterers  distributed  uniformly  on  a  ring  of  radius  Rc  >  Rp 
around  the  interior  sources.  The  sources  are  still  considered 
uncorrelated  and  uniformly  distributed  inside  the  circle  of  ra¬ 
dius  Rm  <  Rp.  Under  the  Bom  approximation,  equation  (19) 
is  once  again  obtained  with  —  Rc ,  but  without  the  aver¬ 
aging  operator.  We  locate  scatterers  very  close  to  the  boundary 
(Rc  =  Rp  +  2a)  and  contrast  that  with  a  situation  where  scat¬ 
terers  are  away  from  it  (Rc  =  Rp  +  40a).  Fig.  5  shows  the 
mode  power  decay  in  both  cases.  It  is  seen  that  while  scatterers 
slow  the  decaying  rate  of  higher  mode  power  in  both  cases,  the 
slowing  is  more  dramatic  when  the  scatterers  are  closer  to  the 
observation  circle  than  when  they  are  away  from  it.  The  higher 
power  available  in  these  higher  order  modes  will  increase  the 
degrees  of  freedom  offered  by  the  electromagnetic  field  when 
their  power  exceeds  the  noise  power.  Such  an  increase  in  the 
degrees  of  freedom  due  to  near-field  coupling  has  previously 
been  reported  by  other  researchers  [27],  [39]  and  generally  re¬ 
ferred  to  as  super-resolution.  In  a  practical  situation,  scatterers 
may  neither  be  close  to  receiver  nor  far  from  it,  and  the  benefits 
will  be  between  the  two  extremes. 

Fig.  6  shows  a  plot  of  the  fractional  power  ratio  Pe/Pt  for 
pa  =  1%  and  Ro/Rm  «  1.36.  Other  parameters  chosen  are 
shown  in  the  figure  legend.  The  ratio  Pe  / Pt  may  be  roughly  in¬ 
terpreted  as  inverse  of  the  signal-to-noise  ratio  (SNR).  In  free- 
space,  the  power  ratio  rolls  off  faster  than  any  exponential  for 
M  >  M0  indicating  that  the  NDOF  in  free-space  is  M0  even 
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Fig.  6.  Power  Pe  contained  in  the  tail  [M  +  1,  oo)  as  a  fraction  of  the  total  Fig.  7  SNR  versus  normalized  degrees  of  freedom  for  a  ring  of  scatterers 
power  versus  the  M .  placed  in  the  near-zone. 


if  other  competing  quantities  (such  as  number  of  sources  Nt, 
power  per  source  PQ(b ),  etc.)  are  made  to  increase  algebraically 
with  M0.  In  other  words,  the  NDOF  is  essentially  independent 
of  SNR.  Identical  results  were  obtained  using  analyses  based 
on  singular  value  decomposition  of  fields  as  carried  out  in  [23]. 
Benefits  of  near-zone  fields  of  sources  alone  are  not  experienced 
here  because  we  are  looking  at  the  real  part  of  the  Poynting 
vector.  This  applies  both  to  interior  and  exterior  sources.  How¬ 
ever,  the  interference  terms  in  the  total  power  arising  from  the 
incident  and  scattered  fields  do  contribute  to  the  real  part.  Hence 
in  the  presence  of  exterior  scatters,  the  power  ratio  rolls  off  much 
more  gradually  (only  as  a  power  law),  thereby  indicating  in¬ 
creased  NDOF  with  scattering.  Fig.  6  also  shows  that  one  needs 
to  have  high  a  SNR  in  order  to  reap  the  benefits  of  increased 
NDOF.  If  the  SNR  is  low  enough,  M  ~  M0.  However,  if  the 
noise  floor  is  such  that  PejP±  —  10-7,  the  NDOF  with  exte¬ 
rior  scatterers  is  equal  to  5 M0 .  This  is  with  a  scatterer  area  den¬ 
sity  of  only  1%.  Higher  densities  and  larger  particle  sizes  could 
lead  to  higher  values  as  it  has  been  established  by  various  re¬ 
searchers  [40],  [29]  that  higher  scatter  densities  lead  to  enhanced 
backscattering.  Furthermore,  if  the  total  power  Pt  is  made  to  in¬ 
crease  with  b  in  the  form  of  the  power  law  Pt  oc  ba ,  one  gets  sig¬ 
nificantly  larger  NDOF  with  scattering  than  in  free- space  when 
a  >  1.  Such  an  increase  in  power  could  be  achieved  either  by 
increasing  the  number  of  nodes  at  an  appropriate  rate,  or  by  in¬ 
creasing  power  per  node,  or  a  by  a  combination  of  the  two.  This 
result  contained  in  (29)  is  in  contrast  to  what  has  been  suggested 
in  [23]  for  the  limiting  case  of  Ni  — ►  oc  and  could  lead  to  much 
higher  transport  capacities  for  finite  sized  wireless  networks  if 
proper  power  scaling  and  node  density  strategies  are  devised. 

Much  of  the  benefit  of  increased  NDOF  comes  from  the  near 
fields  contributed  by  the  scatterers.  In  order  to  better  under¬ 
stand  the  benefit  arising  out  of  the  near-fields,  we  consider  the 
extreme  case  of  scatterers  arranged  uniformly  on  a  ring  of  ra¬ 
dius  Rc  >  Rp.  As  remarked  previously,  one  gets  M0  degrees 
of  freedom  in  freespace,  which  is  rather  independent  on  the 
SNR.  Denoting  the  ratio  of  Pe  =  X)m=M+i  pm  t0  A  as 


and  using  the  approximate  expression  (19)  for  Pm ,  one  gets  for 
M  >  \ekoRc/2 ]  >  M0  after  ignoring  the  free-space  contribu¬ 
tion  PI  that 

Jo(M  2  (RrnVM  2 Q 

\Rc)  R1-RUM+ 1)3- 

(32) 

Fig.  7  shows  a  plot  of  the  SNR  1/y  as  a  function  of  M/M0. 
The  other  parameters  considered  in  this  example  are  shown  in 
the  figure  legend.  It  is  seen  that  higher  NDOF  is  obtained  when 
the  ring  of  scatterers  in  closer  to  the  observation  circle  (radius 
b  «  Rm)  than  when  it  is  farther  out.  It  may  be  noted  that  the 
term  SNR,  used  only  to  represent  the  ratio  Pt/Pe ,  may  not  per¬ 
tain  to  the  actual  SNR  at  a  receiver  node.  Nevertheless,  Fig.  7 
indicates  that  a  high  SNR  is  needed  in  order  to  realize  the  in¬ 
creased  degrees  of  freedom  offered  by  scatterers,  particularly 
for  low  scatter  densities. 

IV.  Conclusion 

By  considering  the  problem  of  line  sources  radiating  in  the 
presence  of  exterior  perfectly  scattering  cylinders  and  decom¬ 
posing  the  real  power  flow  on  an  observation  circle  r  =  b 
in  terms  of  orthogonal  modes,  we  have  shown  that  the  NDOF 
in  free-space  is  fixed  at  M0  =  \ekob/2]  even  if  the  average 
power  per  line  source  PQ  (M0 )  and/or  the  number  of  line  sources 
Ni(M0)  increases  as  a  power  law  with  M0.  This  is  due  to  the 
rapid  drop-off  of  higher-order  mode  power  as  given  in  (25).  In 
the  presence  of  exterior  scatterers  (scatterers  outside  r  =  b) 
the  higher  order  mode  power  decays  only  algebraically  due  to 
backscattering  and  near-field  effects,  thereby  offering  the  poten¬ 
tial  of  increased  NDOF.  In  particular,  we  have  derived  a  closed 
form  expression  (31)  for  the  number  of  degrees  of  freedom  as¬ 
suming  that  the  fractional  area  density  pa  of  scatterers  is  low 
enough  (as  a  rule  of  thumb,  pa  <  0.1)  to  neglect  multiple  scat¬ 
tering.  The  expression  is  applicable  to  large  networks  as  well. 
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It  has  been  demonstrated  that  the  benefits  offered  by  scattering 
will  be  most  effectively  realized  at  high  SNRs. 

Extension  of  the  results  to  3D  should  be  straightforward,  al¬ 
though  the  analysis  is  expected  to  be  more  cumbersome  and  the 
qualitative  results  may  likely  behave  differently  due  to  the  faster 
decay  of  3D  fields  with  distance.  Other  scattering  scenarios  are 
also  of  interest  and  worthy  of  study-isolated  scatter  clusters  sur¬ 
rounding  transmit  and  receive  nodes,  large  scatter  cluster  inter¬ 
vening  an  otherwise  free- space  region  between  transmit  and  re¬ 
ceive  nodes,  transmit  and  receive  nodes  operating  in  the  vicinity 
of  half-space  and  an  intervening  scatter  cluster,  etc.  For  higher 
scatter  density,  more  refined  approximations  such  as  the  Rytov 
approximation  or  those  based  on  diagrammatic  techniques  [41], 
[34],  [42]  are  worth  exploring  and  these  will  be  undertaken 
in  the  future.  The  locations  of  the  line  sources  and  those  of 
the  scatterers  were  assumed  to  be  independent  and  identically 
distributed  (iid)  random  variables.  These  are  expected  to  valid 
for  electrically  small  sized  sources  and  scatterers.  For  larger 
sized  scatterers,  the  two-particle  joint  probability  density  func¬ 
tion  [30]  is  more  appropriate  and  this  will  also  be  pursued  in  the 
future. 
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Abstract 

The  diffusion  and  Schrodinger  propagators  have  been  known  to  coexist  on  a 
lattice  when  a  particle  undergoing  random  walk  is  endowed  with  two  states  of 
spin  in  addition  to  the  two  states  of  direction  in  a  1+1  spacetime  dimension. 
In  this  paper  we  derive  explicit  expressions  for  the  various  transitional 
probabilities  by  employing  generating  functions  and  transform  methods.  The 
transitional  probabilities  are  all  expressed  in  terms  of  a  one-dimensional  integral 
involving  trigonometric  functions  and/or  Chebyshev  polynomials  of  the  first 
and  second  kind  from  which  the  spacetime  continuum  limits  of  the  diffusion 
equation  and  Schrodinger  equation  follow  directly. 

PACS  numbers:  03.65.— w,  05.40.Fb 


1.  Introduction 

There  has  been  a  lot  of  interest  in  the  recent  past  to  understand  quantum  mechanics  in  the 
context  of  classical  statistical  mechanics.  On  the  one  hand,  Brownian  motion  provides  a 
microscopic  model  of  diffusion  and  provides  an  unambiguous  interpretation  of  the  diffusion 
equation.  On  the  other  hand,  a  similar  physical  interpretation  is  lacking  for  the  Schrodinger 
equation,  whose  wave  solution  is  a  complex  quantity  without  a  physical  reality.  Because 
classical  diffusion  cannot  account  for  the  self-interference  pattern  that  is  so  intrinsic  to  quantum 
behavior,  several  theories  have  been  put  forward  recently  to  understand  the  microphysics  of 
quantum  behavior.  Nelson  [1]  derived  the  Schrodinger  equation  starting  from  Newtonian 
mechanics  and  by  assuming  that  a  particle  is  subject  to  an  underlying  Brownian  motion 
described  by  a  combined  forward-in-time  and  a  backward-in-time  Wiener  processes.  A 
detailed  account  of  Nelson’s  original  idea  of  stochastic  mechanics  and  its  subsequent 
refinement  is  given  in  [2-5].  Nottale  [6]  and  Ord  [7]  advanced  the  idea  that  spacetime  is 
not  differentiable  but  is  of  a  fractal  nature,  suggesting  that  an  infinity  of  geodesics  lie  between 
any  two  points  and,  thereby,  providing  a  fundamental  and  universal  origin  for  the  double 
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Wiener  process  of  Nelson.  These  ideas  are  elaborated  in  the  monograph  [8].  El  Naschie  [9] 
too  considered  a  fractal  spacetime  with  a  Cantorial  structure  and  argued  that  quantum  behavior 
could  be  mimicked  by  combining  this  fractal  spacetime  with  a  diffusion  process.  A  totally 
different  paradigm  was  recently  introduced  by  Ord  [10],  who  by  considering  a  symmetric 
random  walk  on  a  lattice,  showed  that  both  the  diffusion  equation  and  the  Schrodinger  equation 
occur  as  approximate  descriptions  of  different  aspects  of  the  same  classical  probabilistic 
system.  By  considering  a  4-state  random  walk  (4RW)  on  a  discrete  lattice,  wherein  a  particle 
is  endowed  with  two  states  of  direction  and  two  states  of  spin,  Ord  [10-12]  has  shown  that 
both  diffusion  and  Schrodinger  propagators  coexist  on  a  lattice  and  that  either  can  be  obtained 
from  a  distinct  projection  of  the  same  random  walk.  It  is  too  early  to  speculate  as  to  which  of 
Nelson’s  or  Ord’s  model  will  duplicate  the  true  quantum  behavior  under  a  variety  of  situations. 
This  can  only  be  ascertained  through  additional  work  on  both  models.  It  may  be  mentioned 
that  the  combination  of  displacement  and  spin  have  also  been  used  previously  in  [13,  14] 
to  study  dynamics  of  a  quantum  particle  in  spacetime.  However,  the  important  distinction 
between  the  Ord  model  and  the  one  considered  in  [13,  14]  is  that  the  states  describing  the 
direction  of  motion  are  independent  of  those  describing  the  spin  states  in  the  former  model. 
There  is  also  an  intrinsic  notion  of  memory  embedded  in  the  Ord’s  model. 

The  Schrodinger  type  of  equation  is  encountered  under  the  guise  of  parabolic  wave 
equation ,  or  simply  parabolic  equation  in  the  solution  of  boundary-value  problems  in  several 
branches  of  applied  physics  such  as  acoustics  [15],  optics  and  classical  electromagnetic  wave 
propagation  [16].  In  such  boundary- value  problems,  inhomogeneities  of  the  propagating 
medium  caused  by  the  varying  index  of  refraction  of  the  intervening  material  take  the  place 
of  the  potential  field  experienced  by  a  quantum  particle.  The  standard  parabolic  equation 
is  resulted  when  one  extracts  paraxial  propagation  along  a  preferred  direction  from  the  full 
Helmholtz  equation.  In  addition  to  providing  a  microscopic  model  for  the  Schrodinger 
equation,  the  4RW  model  considered  by  Ord  is  also  attractive  in  the  solution  of  stochastic 
differential  equations  associated  with  these  parabolic  type  of  equations,  carried  out  by 
employing  only  real  random  processes.  Because  walks  modeling  the  Schrodinger  equation 
in  the  4RW  model  traverse  only  real  space,  no  analytical  continuation  of  boundary  data  into 
complex  space  is  required  that  would  otherwise  be  demanded  [17,  18]  when  solving  these 
boundary- value  problems. 

Ord  does  not  provide  explicit  expressions  for  the  various  transitional  probabilities,  but, 
instead,  discusses  the  continuum  limits  directly  from  the  governing  difference  equations.  For 
a  variety  of  reasons,  it  is  desirable  to  obtain  closed-form  expressions  (or  those  involving 
integrals)  for  these  transitional  probabilities.  In  this  paper,  we  provide  analytical  expressions 
for  the  transitional  probabilities  associated  with  the  4-state  random  walk  in  1+1  dimension 
in  spacetime  by  using  a  transform  approach.  Our  work  here  is  partly  motivated  by  the 
desire  to  have  expressions  for  the  transitional  probabilities  while  solving  the  aforementioned 
boundary- value  problems  using  the  parabolic  equation  in  a  homogeneous  medium.  Using 
these  expressions,  it  is  further  shown  that  in  the  continuum  limits  as  the  mesh  size  shrinks  to 
zero  in  both  space  and  time,  one  directly  recovers  the  diffusion  equation  and  the  Schrodinger 
equation.  Thus,  the  main  contributions  of  the  paper  are  to  (i)  elucidate  methodology  for 
obtaining  the  closed-form  expressions  for  the  various  transitional  probabilities  of  the  4RW, 
and  (ii)  establish  the  continuum  limits  of  the  diffusion  and  Schrodinger  equations  describing 
the  dynamics  of  particles  obeying  the  4RW.  The  methodology  presented  in  this  paper  is 
most  suitable  for  describing  quantum  dynamics  of  a  free-particle,  although  the  4RW  model 
itself  has  been  extended  in  the  presence  of  a  potential  field  [19].  The  paper  is  organized 
as  follows:  section  2  gives  a  brief  introduction  of  the  random  walks  considered  in  [10,  12]. 
Section  3  introduces  the  generating  functions  and  the  2D  transforms  considered  in  this  paper. 
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Table  1.  Various  states  in  random  walk. 


State 

Direction 

Spin 

1 

Right 

+1 

2 

Left 

+1 

3 

Right 

-1 

4 

Left 

-1 

Section  4  provides  expressions  for  the  various  transitional  probabilities  as  well  as  discusses 
the  derivation  of  the  diffusion  equation  and  the  Schrodinger  equation  as  continuum  limits  of 
these  probabilities. 


2.  Multistate  random  walks 

Consider  the  4RW  model  proposed  by  Ord  and  Deakin  [12],  where  a  particle  undergoes  random 
motion  in  discrete  spacetime  (x  =  mA,t  =  56),  with  x  denoting  space  and  t  denoting  time, 
and  A  and  6  denoting  the  spatial  and  temporal  steps,  respectively.  At  every  point  the  particle 
is  endowed  with  two  independent  binary  properties,  its  direction  of  motion  (right  or  left)  and 
its  spin  or  parity  (±1).  The  particle  is  assumed  to  change  its  direction  with  every  collision, 
but  change  its  spin  only  every  other  collision.  The  four  states  of  the  particle  corresponding 
to  the  four  combinations  of  direction  and  spin  are  indicated  in  table  1 .  Note  that  the  particle 
can  execute  any  direction  of  motion  irrespective  of  the  spin,  in  contrast  to  the  model  used  in 
[13,  14].  However,  there  is  an  intrinsic  assumption  of  memory  in  Ord’s  model  that  arises  from 
keeping  track  of  the  parity  of  collisions.  If  p^tm A,  56) A,  /x  =  1,  . . . ,  4,  is  the  probability 
that  a  particle  is  in  state  /x  at  the  spacetime  point  (m  A ,  56),  m  =  0,  d=l,  ±2,  . . . ,  5  =  0,  1, ... , 
then  the  transitional  relations  considered  in  [12]  were  of  the  form 

Pi[mA,  ( s  +  1)6)]  =  ap\[(m  —  1)A,  se]  +  fip\\{m  +  1)A,  56] 

P2[mA,  ( 5  +  1)6)]  =  otp2[(m  +  1)A,  56]  +  /3p\[(m  —  1)A,  56] 

(1) 

pilmA,  (s  +  1)6)]  =  apiKm  —  1)A,  56]  +  /3p2[(m  +  1)A,  56] 

P4[mA,  ( s  +  1)6)]  =  ap^iim  +  1)A,  se]  +  fipslim  —  1)A,  56], 

where  a  +  /3  =  1.  Here,  a  is  the  probability  that  a  particle  maintains  its  direction  at  the  next 
time  step,  whereas  /3  is  the  probability  that  it  will  change  its  direction  at  the  next  time  step. 
The  Markov-chain  character  of  the  transitional  probabilities  is  evident  from  definitions  in  (1). 
From  the  total  probability  theorem,  the  probability  that  a  particle  is  somewhere  on  the  lattice 
at  a  given  time  is  equal  to  1  and  is  represented  mathematically  by 

4  oo 

E  E  Pn(mA,  se)A  =  1.  (2) 

li=  1  m=—o o 

Ord  [10]  has  shown  that  the  diffusion  and  Schrodinger  propagators  coexist  on  the  lattice 
and  that  both  behaviors  are  embedded  in  equations  (1).  To  affect  a  separation  of  the 
diffusive  behavior  from  the  wave-like  behavior,  the  following  linear  transformation  is 
used:  qi(mA,se)  =  2s^2[p\(mA,  se)  —  p3(mA,s€)],q2(mA,s€)  =  2s^2[p2(mA,  se)  — 

P4(mA,  56)],  w\{m A,  56)  =  [ p\{mA ,  56)  +  p2(mA ,  56)  +  p^imA,  se)  +  p4(mA,  56)],  and 

W2(mA,se)  =  [pi(mA,se)  +  p^imA.se)]  —  [p2(mA,se)  +  p4(mA,se)].  The  quantity 
qiA  (without  the  weight  factor  2s /2)  indicates  the  expected  difference  in  the  number  of 
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particles  of  opposite  spin  arriving  at  (m A,  sc)  while  moving  to  the  right.  Similarly,  q2A 
refers  to  the  expected  number  of  particles  arriving  at  (mA,s€)  while  moving  to  the  left. 
Also,  w\{mA,s€)A  is  the  probability  that  a  particle  leaves  (mA,s€)  in  either  direction 
and  in  any  spin  state,  and  W2(mA,  se)  A  is  the  difference  in  the  probabilities  that  a  particle 
leaves  (mA,  sc)  to  the  right  and  the  left.  Introducing  the  shift  operator  Efx p^m A,  se)  — 
p^iim  =b  1)A,  s€],  a  time- advancing  operator  Etp^imA,  sE)  —  p^lmA,  (s  +  1)6],  and  the 
vector  p  =  [pi,  p2,  ps,  Pa\t  ,  where  the  superscript  T  denotes  transpose,  the  transitional 
relations  in  (1),  which  are  of  the  form  Et p  =  S*p,  get  transformed  into 


E  A1)  =  -(  {Ex  + E;V)  Ex ~ E;V)  \  A1) 

'  W  2  \(a  -  p)(Ex  -  E ;l)  (a  -  p)(Ex  +  E;1) )  W  ’ 


Thus  the  variables  (w i,  w2)  get  decoupled  from  (qi,  q2).  Essentially,  this  decoupling  results 
from  block-diagonalizing  the  matrix  S*  and  describing  the  system  in  terms  of  its  eigenstates. 
The  physical  significance  of  this  transformation  is  touched  upon  in  [11,  12].  Note  that 
wj  and  qj  need  not  strictly  be  probabilistic  quantities  (meaning  ^0),  but  we  will  continue  to 
describe  them  as  ‘transitional  probabilities’  with  the  understanding  that  the  actual  probabilistic 
quantities,  namely,  p can  be  easily  recovered  from  these  using  the  inverse  relations. 


3.  Generating  functions  and  transforms 


We  are  interested  in  the  solutions  of  (3)  and  (4)  for  the  special  case  of  a  symmetric  random 
walk  with  a  =  =  0.5.  In  this  case  we  have  a  set  of  linear  difference  equations  and 

the  solution  can  be  obtained  conveniently  using  transform  methods  [20,  21]  and  appropriate 
generating  functions.  The  key  step  here  is  to  pick  a  suitable  transform  consistent  with  the 
nature  and  domain  of  definition  of  the  problem.  We  denote  the  2D  transform  £,  consisting 
of  a  Fourier  transform  in  space  (owing  to  the  unbounded  nature  of  the  spatial  coordinate)  and 
the  z-transform  [22]  in  time  (the  z-transform  can  be  arrived  from  the  discretized  version  of  a 
Laplace  transform  and  is  suitable  for  discrete  functions  defined  on  a  half-line),  of  a  discrete 
function  v{m A,  se)  as  V ( kx ,  z)  and  define 

CO  CO 

V(kx,z)  =  A  ^  ^(^A,  se)zs  Q~lmkxA  =  Cv(mA,  se).  (5) 

m=— oo  5=0 

The  inverse  relation  can  then  be  obtained  as 

i  r*/A  r  y(b  7\ 

v(mA,se)  = J  j)  — ^ — emkxA  dkxdz  =  C~lV(kx,  z),  (6) 

where  the  identities 

f  ei(n~m)kxAdkxA  =  27tSl  (7) 

J  kxA  =—7T 


d  z  =  27ri<^ 


(8) 


are  used  to  derive  (6).  Here  5"  is  the  Kronecker’s  delta  and  Cz  is  a  closed  contour  around  the 
origin  in  the  complex  z-plane  that  encloses  only  the  singularities  at  the  origin.  The  present 
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analysis,  consisting  of  the  z-transform  along  the  time  axis  and  Fourier  transform  along  the 
spatial  axis,  is  most  suitable  for  studying  linear  difference  equations  with  constant  coefficients 
such  as  encountered  in  the  study  of  free-Schrodinger  equation  by  the  4RW  model.  Other 
suitable  methods  must  be  devised  for  studying  particle  motion  in  the  presence  of  a  potential 
field.  Note  that  V ( kx ,  z)  is  periodic  in  kx  with  a  period  2tt / A.  Using  the  definition  in  (5),  it 
can  also  be  shown  that 

Cv[mA,  (s  +  l)e]  =  z"1  [V(kx,  z)  -  V0(kx)]  (9) 

Cv[(m  ±  1)A,  se]  =  e±ik'AV(kx,  z),  (10) 

where  Vo  (kx )  is  the  Fourier  transform  of  the  initial  distribution  v(m  A,  0): 

00 

V0(kx)  =  A  J2  v(mA,0)e-“'4.  (11) 

m = — oo 

Note  that  the  periodicity  property  of  Vq (kx)  implies  that  Vq(tt/ A)  =  Vo(—tt/  A). 


4.  Transitional  probabilities 

Having  defined  the  required  transforms,  we  will  now  derive  expressions  for  the  transitional 
probabilities  uq,  u>2,  qi  and  q2.  Because  of  the  decoupling  afforded  in  (3)  and  (4),  it  is 
sufficient  to  consider  the  diffusive  and  wave-like  behaviors  separately. 


4.1.  Diffusive  behaviour 

The  diffusive  part  of  the  particle  motion  is  governed  by  the  discrete  functions  w\  and  W2  as 
will  be  evident  shortly.  Let  W\{kx,  z)  and  W2(kx,  z)  be  the  2D  transforms  of  uq(raA,  se)  and 
u;2(raA ,  56)  and  Yife)  and  T2 (kx)  be  the  transforms  of  the  initial  distributions  w\(m A,  0) 
and  iu2(raA,  0),  respectively.  From  the  definition  of  w\  in  terms  of  p^,  /x  =  1,  . . . ,  4,  and 
relation  (2),  it  is  seen  that  Yi(0)  =  1.  On  applying  the  transform  C  to  the  set  (3)  and  making 
use  of  the  properties  (9)  and  (10),  it  is  easy  to  see  that  z)  =  Y2fe)  and 


W!(kx,z) 


Ttfej-usinfeAjTzfe) 
1  —  z  cosfe  A) 


00 

=  ^  z"  cosn(kxA)  [Ti (kx)  -  iz  sinfe  A)T2fe)] 

n= 0 


(12) 

(13) 


where  (13)  has  been  obtained  by  using  the  series  expansion  of  [1  —  z  cosfe  A)]-1.  Such  a 
series  converges  uniformly  provided  that  |z  cos(kx  A)|  <  1  and  this  can  always  be  insured  by 
choosing  an  appropriate  Cz  in  (6).  In  other  words,  the  contour  Cz  is  chosen  such  that  the 
zeroes  of  the  function  1  —  z  cosfe  A)  lie  outside  it.  Substituting  this  into  (6)  and  making  use 
of  (8),  we  finally  arrive  at 

l  r/A 

u>i(mA,  je)  =  —  /  cosI(^A)[T1fe)  -  i0(j  -  1)  tanfe  A)T2(k,)]  e"‘'A  dkx,  (14) 

Z7t  J-jt/a 

where  ©(•)  is  the  Heaviside  step  function.  For  a  given  Yi  {kx)  and  Y 2fe),  integral  (14)  may  be 
computed  efficiently  by  the  application  of  the  inverse  fast  Fourier  transform  (iFFT)  algorithm 
[22].  However,  for  special  values  of  Yifc)  and  Y 2fe),  the  integral  may  be  evaluated  in 
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Figure  1.  Calculated  values  of  se)  for  T\(kx)  =  1,  T2(kx )  =  0. 


a  closed  form.  For  example,  with  uq(raA,0)  =  ^-<5° ,  w2{mA,  0)  =  0(=^  Yife)  = 
1,  Y2fe)  =  0)  and  m  and  5  even,  (14)  reduces  to  ([23],  3.631-17) 


w\(mA,  sc)  A 


1 

2s 


( 


(s  —  m)/ 2/ 


m  ^  s. 


(15) 


The  right-hand  side  of  (15)  gives  the  probability  of  finding  a  particle  at  m  in  5  steps,  given  that 
it  started  at  the  origin  at  5  =  0,  in  a  symmetric,  discrete-time,  ID  random  walk.  The  result  can 
be  obtained  directly  from  combinatorial  analysis  and  is  available  in  standard  texts  ([24],  p  75), 
([25],  p  16).  Figure  1  shows  a  plot  of  w\{mA,  sc) A  for  5  =  20,  30  and  40,  where  the  data  at 
discrete  m  has  been  connected  by  smooth  lines  for  the  sake  of  visual  clarity.  The  plots  clearly 
exhibit  the  diffusive  behavior  of  w\,  wherein  w\  spreads  out  in  space  with  a  diminishing  peak 
value  as  5  increases.  Using  the  identity  J2m=-oo  exp(zbirax)  =  2jr8(x),  —7t  ^  x  ^  tt,  where 
<5(-)  is  the  delta  function,  it  may  be  easily  verified  from  (14)  that  Ylm=-o o  w>i(mA,sc)A  =  1. 
Also  note  that  w\  >  0.  Hence  w\  A  behaves  like  a  true  probability  mass  function. 

We  are  also  interested  in  the  continuum  limits  A^0,e— >-0,ra— >-oo,  and  s  oo 
such  that  A2 /2c  =  D  >  0,mA  -a-  x,sc  — >►  t.  Using  the  results  lim  a^o  [cos^fe  A)]  = 

exp  (— k2Dt ),  limA^o  [cos5(/:x  A)  tan(&x  A)]  =  0  in  (14),  we  arrive  at 
1  C°° 

Wi  (x,  t)  =  —  Ti  (kx)  t~k*Dt  e'kxX  d kx .  (16) 

2^  J —oo 


This  is  the  well-known  solution  of  the  diffusion  equation  dw\/dt  =  Dd2w\/dx2  in  an 
unbounded  medium  with  an  initial  spectral  content  Yife)  (see,  for  example,  [26]).  For  an 
impulsive  initial  condition,  Yife)  =  1,  and  one  recovers  the  Green’s  function  w\(x,  t )  = 
exp(— x2 /ADt ) /V 47r Dt.  The  function  w\(mA,  sc)  given  in  equation  (14)  is  the  discrete 
version  of  w\(x,  t)  and  is  seen  to  depend  not  only  on  Yi (kx),  but  also  on  T2(kx).  The  latter 
contribution  arises  entirely  from  the  discrete  nature  of  space  and  vanishes  in  the  continuum 
limit.  To  summarize,  the  quantity  uq(raA,  56)  A  that  describes  the  probability  that  a  particle 
leaves  (m A,  sc)  in  either  direction  and  in  any  spin  state  describes  the  diffusion  process  for  a 
symmetric  4RW. 
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4.2.  Wave-like  behaviour 


The  wave-like  behavior  of  the  particle  motion  is  governed  by  the  discrete  functions  q\  and  q2. 
The  governing  equations  in  this  case  are  repeated  below  from  (4): 


Our  objective  here  is  to  derive  closed-form  expressions  for  the  transitional  probabilities  q\ 
and  q2.  Let  Qj(kx,z )  be  the  C  transforms  of  qjimA,  se),  and  let  Tj(kx)  be  the  Fourier 
transforms  of  the  initial  distribution  qj(mA,0),  j  =  1,  2.  On  applying  the  C  transform  to 
(17)  and  making  use  of  properties  (9)  and  (10)  and  carrying  out  some  algebraic  manipulations, 
we  get 


'Gi(**.z)l 

1 

“  1  z  (jkx  A 

1  V2e  ' 

z  pXkx A  “ 
V2e 

Tjfe)] 

Qi(kx,z)  J 

(1  -  V2 Z  cos(kx  A)  +  Z2) 

z  ~-ikxA 

L  V2e 

1  z  fz—ikxA 

1  V2C  J 

r2(kx)\ 

To  permit  evaluation  of  the  integral  with  respect  to  z  in  the  inverse  transform,  we  need  to 
express  Q\  and  Q2  in  a  separable  form  with  respect  to  kx  and  z.  To  this  end,  we  make  use  of 
the  identity  ([23],  8.945.2) 


1 

1  —  2  tx  + 1 2 


00 

YJUn(X)t\ 

0 


(19) 


where  £/„(•)  is  the  Chebyshev  polynomial  of  the  second  kind  of  order  n,  in  (18)  to  arrive  at 


Qi(kx,z ) 


Qi(kx,z) 


Z  —ikx At-.  ^7  x  .  ^ 


vT' xAr^\ 


( cosk,A\ 


A?  e-^iM*,)  +  (1  -  -A  e-^A  j  r2ar)J . 


V2 


(20) 

(21) 


As  with  the  diffusive  case,  the  contour  Cz  in  the  inverse  transform  is  chosen  such  that  the 
zeroes  of  the  denominator  function  (1  —  \flz  cos(kx  A)  +z2)  lie  outside  it.  Equations  (20)  and 
(21)  may  be  substituted  into  the  definition  of  the  inverse  transform  (6)  and  the  integral  with 
respect  to  z  evaluated  by  making  use  of  (8).  For  reasons  that  will  become  clear  shortly,  we 
are  interested  in  the  composite  discrete  function  fc(mA,  se)  =  q2(mA,  se)  +  iq\{mA,  se), 
which  will  be  compared  directly  with  the  solution  of  the  Schrodinger  equation.  The  expression 
for  is 

1  fnlA  \  /ms  k  A  \ 

fd(mA,se)  =  —  J  1 14  (— -^=r=J  [Fz  +  irjfe)] 

(cos k  A \ 

-J=~)  [(e_iir/4r  1  (kx)  -  e^4r2fe))cosfeA) 

+  (e-^r^*,)  +e*/4r2(kx))  sinfoA)]  J  eim^A  d kx.  (22) 

As  in  section  4.1,  the  integral  in  (22)  may  be  evaluated  efficiently  by  employing  the  iFFT 
algorithm.  In  the  special  case  of  Ti  (kx)  —  0,  T2(kx)  —  K2,  a  constant,  the  expression 
provided  in  (22)  can  be  further  simplified.  Making  a  change  of  variable  y  =  cosfeA) 
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and  using  dy/^/l  -  y2  =  —dkxA,  cos(mcos  1  y)  =  Tm(y ),  where  Tm(-)  is  the  Chebyshev 
polynomial  of  the  first  kind  of  order  ra,  we  can  show  that 


xf/dimA,  sc)  A  =  — 


=  /*' _ 1 _ { 

7T  ]_  i  ^1  -  y2  l 


v  1 1= 


V2 


T’ml'y)  -  (  Af 


(ti) 


X  [rm_i (y)  +  irm+i (y)]  |  dy .  (23) 

From  the  even  and  odd  properties  of  Chebyshev  polynomials,  it  can  be  deduced  that  for 
s  —  2r  and  m  —  In  —  1  (or  vice  versa),  the  integral  in  (23)  vanishes  implying  that 
V^[( 2n  —  1)A,  2 re]  =  0  in  this  special  case. 

Other  interesting  identities  can  be  derived  starting  from  (22).  Using  the  relation 
fe(l/V2)  =  jy*  [cos(jr/4)]  =  sin(s7r/4)  +  cos(stt/4),  one  can  readily  see  that 
00 

J2  fd(mA,se)A  =  e"ilrs/4  [r2(0)  +  ir^O)] .  (24) 

m=— oo 

Hence,  unlike  w\  A,  the  quantities  q\  A  and  ^2  A  can  be  of  alternating  signs  and  do  not  represent 
true  probability  mass  functions. 

Ord  [11]  has  shown  that  eight  different  continuous  functions  are  embedded  into  the 
discrete  functions  q\  and  q2.  We  will  focus  on  the  continuous  function  that  would  result 
from  choosing  x  =  2nA,n  —  0,  =bl,  ±2,  . . . ,  and  t  —  8 rc,  r  —  0,  1,  2, . . . ,  in  the  discrete 
functions  q\  and  q2.  We  show  that  x\rd  satisfies  the  Schrodinger  equation  for  m  —  2 n,  s  =  8r  in 
the  limit  as  A  ^  0,  e  — 0  ,n  —>  00  ,r—>  00  such  that  A2 /2c  =  D.  The  following  identities 
[23,  27]  involving  Chebyshev  polynomials  will  be  utilized  in  subsequent  development: 


zUs-dz)  =  us(z)  -  TS(Z) 


—  Ts(z)  —  sUs-i(z) 

dz 


(*) 


:  COS 


(1  -  z2)T''(z)  -  zT'(z)  +  s2Ts(z)  =  0 


(25) 

(26) 

(27) 


f/'-'(A)  =  '/5sin(V)- 


(1  -z2)U'\z)  -3zU'(z)+s(s+2)Us(z)  =  0,  (28) 


where  a  prime  denotes  differentiation  with  respect  to  the  argument.  For  the  purpose  of 
investigating  the  continuum  limits,  we  would  like  to  cast  (22)  in  a  form  more  suitable  for 
asymptotic  analysis.  The  last  term  in  (22)  involving  Us- 1(-)  can  be  replaced  with  dTs(-)/dkx 
on  using  the  second  relation  (26)  to  yield 
sin  kx  A 


V2 


.  /  cos  kx  A  \  —Id  /  cos  kx  A  \ 

s~l  \~sr ) =  jAdk~/s  (  41  ) 


(29) 


This  term  is  then  integrated  by  parts  and  simplified  using  the  periodicity  condition  Vj  (tt/  A)  = 
r7(— 7r/A),  j  =  1,2.  A  convenient  expression  for  the  evaluation  of  x\rd{m A,  sc)  is  then 
obtained  as 

1  ri r/A 

”"'|[rife)-ir2fe)]i/J 


fd(mA,se )  =  — 


+  (1  + 


/jr/A  t 

eimkxA\{ 

-jr/A  [ 

"(I1 


r  .m~ 

r2fe)  + 

m 

1+1- 

1+  — 

L  ^  J 

5  _ 

(cos  kxA\ 

TF" ) 

M“v2 


rife) 


cos  kx  A 


1  +  i  ,  (  cos  kx  A  \  1 

+  — tr'fe)  -  ir;fe)]r,  (— J  J  d kx, 


(30) 
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which  is  also  more  amenable  to  asymptotic  analysis  than  (22).  In  the  special  case  of 
Tifc)  =  0,  T2(kx)  =  K2  and  for  m/s  ^  0  (small  spatial  locations  and  large  times)  we 
move  on  using  (25)  that 


\//d(mA,s€) 


A  r,A  jmkx  A  I"  (  cos  kx  A  \  .  cos  kx  A 

2^ J-./a  La  V2  ;  V2 


(31) 


We  now  perform  an  asymptotic  analysis  for  small  A  in  (31)  and  show  that  i/^(2nA,  8re) 
satisfies  the  Schrodinger  equation.  To  this  end,  we  note  the  following  Taylor  series  expansions 
which  are  obtained  by  making  use  of  (26)-(28): 


cos  kx  A 


k2x  A2  (kx  A)4 

— -  +  -  +  •  •  • 

2  4! 


feA)V 

4! 


x 


+  . . . 


(32) 


(33) 


(34) 


Inserting  (32)-(34)  into  (31)  and  choosing  s  =  8r,  A2  =  2 De,  s€  =  t,mA  =  x,  s  -a-  oo, 
m  — >►  oo,  A  — >  0,  €  -a-  0,  we  arrive  at  the  desired  result: 


^ d(x,t )  =  q2(x,t)  +  iqi(x,t) 


-  i Dk\t 


In 


Q-iDkltQikxx  ^ 


k4xD2t 2 
2! 


(35) 


Equation  (35)  is  the  spectral  representation  of  the  Green’s  function  corresponding  to  the 
Schrodinger  equation  d\j//dt  =  iDd2\ls/dx2  with  the  impulsive  initial  condition  \//(x,t  = 
0+)  =  K28(x).  It  has  the  exact  solution 

f(x,  t )  =  -  =  e“2/4Dg.  (36) 

V 4jtiDt 

To  reinforce  to  the  reader  that  the  plots  of  the  transitional  probabilities  (qi,  q2)  do  resemble 
the  solutions  of  the  free  Schrodinger  equation,  we  show  in  figure  2 a  comparison  of  the  real, 
9^,  and  imaginary,  S,  parts  of  the  exact  solution  (36)  of  the  Schrodinger  equation  with  the 
partial  solution  (< q\ ,  q2)  of  the  4RW.  The  numerical  solutions  shown  in  the  figure  for  \//d  are 
on  a  discrete  spacetime  (x  =  mA,t  =  sc)  and  have  been  computed  using  (31)  with  the 
iFFT  algorithm  [22]  with  size  s  =  213  =  8192.  It  is  seen  that  the  4RW  produces  solutions 
of  oscillatory  type  with  both  positive  and  negative  excursions  for  the  expectations  q\  and  q2 , 
which  are  in  excellent  agreement  with  the  analytical  results  for  small  ™ .  This  is  in  contrast  to 
the  quantity  w\  shown  in  figure  1,  which,  behaving  like  the  solution  of  the  diffusion  equation, 
decays  exponentially  in  space  and  always  remains  positive. 
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Figure  2.  Comparison  of  the  exact  solution  of  Schrodinger  equation  with  the  discrete 
solution  of  a  4RW  for  an  impulsive  initial  condition.  ( a )  q2(mA,  se),di{\lr(mA,  se)}  and  ( b ) 
q\  (mA,  se),  se)}. 


5.  Summary 

By  considering  a  multistate  random  walk  on  a  discrete  lattice,  expressions  have  been  derived 
for  the  various  transitional  probabilities  using  the  concept  of  generating  functions.  A  2D 
transform  involving  Fourier  transformation  in  space  and  the  z -transformation  in  time  is 
employed  to  accomplish  this.  The  transitional  probabilities  governing  particle  motion  are 
expressed  in  terms  of  integrals  involving  trigonometric  functions  in  the  case  of  the  diffusion 
equation,  and  involving  Chebyshev  polynomials  of  the  first  and  second  kinds  in  the  case 
of  the  Schrodinger  equation.  Closed-form  expressions  have  been  given  for  particular  cases 
of  the  initial  conditions.  The  continuum  limits  of  the  diffusion  equation  and  Schrodinger 
equation  have  been  shown  to  follow  directly  from  these  transitional  probabilities  through 
the  performance  of  appropriate  asymptotic  analysis.  The  present  analysis  consisting  of  the 
z -transform  along  the  time  axis  and  Fourier  transform  along  the  spatial  axis  is  most  suitable 
for  studying  linear  difference  equations  with  constant  coefficients.  In  the  4RW  model,  this 
would  correspond  to  the  free  Schrodinger  equation.  The  important  extension  of  this  analysis  to 
higher  dimensions  is  worth  exploring  and  would  be  taken  up  in  the  future.  The  incorporation 
of  a  smooth  potential  field  in  the  Schrodinger  equation  into  the  4RW  model  has  already  been 
addressed  by  Ord  in  [19]  and  the  study  of  its  transitional  probabilities  will  be  taken  up  in  a 
separate  paper  using  a  different  approach. 
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The  four-state  random  walk  (4RW)  model,  wherein  the  particle  is  endowed  with 
two  states  of  spin  and  two  states  of  directional  motion  in  each  space  coordinate, 
permits  a  stochastic  solution  of  the  Schrodinger  equation  (or  the  equivalent  para¬ 
bolic  equation)  without  resorting  to  the  usual  analytical  continuation  in  complex 
space  of  the  particle  trajectories.  Analytical  expressions  are  derived  here  for  the 
various  transitional  probabilities  in  a  4RW  by  employing  generating  functions  and 
eigenfunction  expansions  when  the  particle  moves  on  a  1  + 1  space-time  lattice  with 
two-point  boundary  conditions.  The  most  general  case  of  dissimilar  boundaries 
with  partially  reflecting  boundary  conditions  is  treated  in  this  paper.  The  transi¬ 
tional  probabilities  are  all  expressed  in  terms  of  a  finite  summation  involving  trigo¬ 
nometric  functions  and/or  Chebyshev  polynomials  of  the  second  kind  that  are  char¬ 
acteristics  of  diffusion  and  Schrodinger  equations,  respectively,  in  the  4RW  model. 
Results  for  the  special  case  of  perfectly  absorbing  boundaries  are  compared  to 
numerical  values  obtained  by  directly  counting  paths  in  the  random  walk 
simulations.  ©  2009  American  Institute  of  Physics.  [DOI:  10.1063/1.3122768] 


I.  INTRODUCTION 

The  four-state  random  walk  (4RW)  model,  wherein  a  particle  undergoing  random  walk  is 
endowed  with  two  states  of  direction  (in  a  one-dimensional  case)  and  two  states  of  spin  or  parity, 
was  considered  by  Ord  and  Deakin1  to  arrive  at  a  macroscopic  model  for  the  Schrodinger  equation 
and  physically  interpret  its  wavelike  solutions.  It  was  shown  in  that  paper  that  both  the  traditional 
diffusion  equation  as  well  as  the  Schrodinger  equation  were  embedded  in  the  same  physical 
model.  The  usual  diffusion  process  is  contained  in  the  overall  sum  of  all  particle  paths  irrespective 
of  their  direction  and  parity,  while  the  wavelike  behavior  of  the  Schrodinger  equation  is  contained 
in  the  differences  in  densities  of  the  right-going  particles  or  left-going  particles  with  opposite 
parity.  The  4RW  model  owes  its  existence  to  the  Feynman  chessboard  model  as  elaborated  in  Ref. 
2  and  is  also  useful  in  solving  practical  electromagnetic,  acoustic,  and  optical  boundary  value 
problems  for  the  complex  field  amplitude  when  a  stochastic  approach  is  used  to  treat  the  govern¬ 
ing  parabolic  equation.  (In  the  applied  sciences  area,  the  parabolic  equation  is  sometimes  referred 
to  as  the  parabolic  wave  equation.)  The  standard  parabolic  equation  used  in  such  time-harmonic 
problems  contains  partial  derivatives  with  respect  to  the  spatial  coordinates  only,  where  the  spatial 
coordinate  along  the  axial  direction  takes  the  place  of  the  time  variable  in  the  time-dependent 
Schrodinger  equation.  Furthermore,  the  potential  function  present  in  the  Schrodinger  equation  is 
replaced  by  the  medium  refractive-index  term  in  the  parabolic  equation.  The  parabolic  equation  is 
obtained  when  the  Helmholtz  equation  describing  the  true  field  is  subject  to  a  one-way  propaga¬ 
tion  with  a  subsequent  application  of  the  paraxial  approximation.3,4  Normally  one  needs  to  resort 
to  analytical  continuation  of  boundary  data,  as  is  done  in  Ref.  5,  when  the  parabolic  equation  is 
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solved  numerically  using  a  stochastic  approach.  The  resulting  random  walks  will  then  traverse  a 
complex-valued  space,  which,  in  turn,  calls  for  analytical  continuation  of  boundary  data  and  the 
spatial  geometry.6  However,  the  4RW  model  permits  a  solution  to  these  problems  without  such 
analytical  continuations. 

In  a  previous  paper,7  the  author  developed  expressions  for  the  various  transitional  probabilities 
for  the  4RW  on  a  discrete  lattice  for  spatially  unbounded  case.  In  addition  to  detailing  a  method 
for  arriving  at  the  transitional  probabilities,  the  results  presented  therein  could  also  be  useful  in 
determining  other  stochastic  quantities  of  interest  such  as  the  first  passage  time  probabilities, 
expected  number  of  visits  to  a  given  site,  and  maximum  excursions  of  a  random  walk  on  a  line  for 
various  linear  combinations  of  these  probabilities.  In  developing  numerical  schemes  for  solving 
boundary  value  problems  with  complex  geometries,  it  is  desirable  to  have  analytical  solutions  for 
simpler  geometries  to  facilitate  validation  against  benchmark  problems.8  The  traditional  way  to 
discretize  the  Schrodinger  equation  or  the  diffusion  equation  for  numerical  treatment  by  the  finite 
difference  method  is  to  employ  a  central  difference  formula  in  the  spatial  coordinates.  An  example 
of  this  is  the  implicit  Crank-Nicolson  scheme,  which,  for  the  diffusion  equation,  can  be  identified 
with  the  traditional  two- state  random  walk,  where  the  particle  is  endowed  with  two  directions  of 
motion  only.  Analytical  results  for  the  traditional  two-state  random  walk  with  perfectly  absorbing 
and/or  reflecting  boundaries  have  been  treated  in  number  of  works  including  Refs.  9  and  10. 
Separately,  the  case  of  the  telegraph  equation  with  partially  reflecting  boundaries  is  studied  in  Ref. 
11.  No  such  analytical  results  are  yet  available  for  the  4RW  model  and  it  is  the  purpose  of  the 
present  paper  to  provide  analytical  results  for  a  benchmark  initial-boundary-value  problem  in  1 
+ 1  space-time  dimension  for  the  model.  To  this  end,  we  extend  the  results  in  Ref.  7  by  considering 
two-point  boundary  conditions  for  the  4RW  model  and  derive  analytical  expressions  for  various 
transitional  probabilities.  Setting  aside  the  fact  that  the  4RW  model  has  a  physical  basis  in  the 
Feynman  chessboard  model  and  that  various  transitional  probabilities  are  related  to  the  solution  of 
the  continuous  Schrodinger  equation,  it  is  not  at  all  obvious  at  the  outset  from  the  governing 
difference  equations  that  an  analytical  solution  is  possible  for  the  said  boundary  value  problem, 
particularly  for  the  wavelike  solutions.  The  transform  approach  utilized  in  this  paper  will  reveal 
the  presence  of  the  discrete  Laplacian  operator  that  is  embedded  in  these  equations  and  will  clearly 
demonstrate  why  such  a  solution  is  still  possible,  while  paving  the  way  for  eigenfunction  expan¬ 
sion.  This  will  be  elaborated  in  Secs.  II  and  III.  The  most  general  case  of  partially  absorbing  and 
dissimilar  boundaries  is  considered  in  this  paper.  Results  for  the  special  cases  of  perfectly  absorb¬ 
ing  and  perfectly  reflecting  boundaries  are  also  provided  in  the  paper.  The  results  presented  here 
correspond  to  the  solution  of  the  discrete  form  of  the  diffusion  equation  as  well  as  to  the  real  and 
imaginary  parts  of  the  discrete  Schrodinger  equation. 

In  Sec.  II,  the  4RW  model  is  briefly  reviewed,  and  the  problem  under  investigation  is  defined. 
In  Sec.  Ill,  the  solution  to  the  4RW  model  subject  to  the  general  boundary  conditions  is  developed 
using  the  concept  of  generating  functions  and  eigenfunction  expansion.  Expressions  are  provided 
for  the  special  cases  of  perfectly  reflecting  and  perfectly  absorbing  boundaries  and  the  results  for 
the  latter  are  compared  to  numerical  simulations  obtained  by  directly  counting  paths.  Finally, 
conclusions  and  topics  of  further  research  are  given  in  Sec.  IV.  It  may  be  noted  parenthetically  that 
it  is  not  our  purpose  here  to  evaluate  other  various  models  that  have  been  put  forward  to  physically 
interpret  the  Schrodinger  equation,  a  topic  that  is  immensely  interesting  in  its  own  right. 


II.  4RW  MODEL 

For  a  particle  moving  on  a  discrete  lattice  and  subject  to  random  collisions,  the  transitional 
probabilities  considered  in  Ref.  7  at  the  discrete  space-time  point  (x=mA,t=se)  are  of  the  form 


(wi\  =  U(ex+e;1)  -(ex-etxx)\(wx 

\  w2)  2\  0  0  / \w2 
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E, 


<h 

<h 


J_/A‘  -^\/9l\ 
V2  W  Ex  )\q2r 


(2) 


where  q !  (m  A  ,.V6)  =  2  s/2\p  ]  (m  A ,  s  e)  -p3(m\ ,  s  6)] ,  g2(m  A  ,se)  =  2s/2[p2(m\ ,  s  e)  -p4(m\ ,  s  e)  ] , 
Wi(mA,se)  =  [pi(mA,se)+p2(mA,se)+p3(mA,se)+p4(mA,se)],  w2(rnA,se)  =  [pi(mA,se) 

+p3(mA.,se)]-[p2(mA,se)+p4(mA,se)],  and  pIUL(mA,se)A,  /z=l,...,4,  is  the  probability  that  a 
particle  is  in  state  /z  at  the  space-time  point  m=0,±l,±2,...,ky  =  0,l,....  The  particle 

changes  its  direction  of  motion  with  every  collision,  but  changes  its  parity  or  spin  at  every  other 
collision.  The  combination  of  two  directions  of  motion  and  two  states  of  spin  constitute  the  four 
states  in  the  model.  It  has  been  shown  in  Refs.  1  and  12  that  such  a  four- state  random  walk 
simultaneously  encompasses  the  diffusion  as  well  as  Schrodinger  equations.  The  quantities  nq  and 
w2  pertain  to  the  diffusion  process,  while  q2  and  ql  correspond  to  the  real  and  imaginary  parts  of 
the  Schrodinger  wave  function  in  the  discrete  case.  We  will  refer  to  (1)  as  the  diffusion  equation 
and  to  (2)  as  the  Schrodinger  equation  even  though  they  are  really  the  respective  discrete  coun¬ 
terparts  of  the  traditional  diffusion  and  Schrodinger  equations.  The  operators  Ex  and  Et  are, 
respectively,  the  spatial  and  temporal  advancing  operators  and  are  defined  mathematically  as 
E^1pJUi(mA,se)=pJUi[(m±l)A,se]  and  EtpfJi(mA,se)=plu[mA,(s+  l)e].  It  is  assumed  in  Eqs.  (1) 
and  (2)  that  the  probability  that  a  particle  maintains  its  direction  at  the  next  time  step  remains  the 
same  as  the  probability  that  it  will  change  its  direction  at  the  next  time  step  and  that  the  probability 
of  remaining  at  the  same  location  at  the  next  time  step  is  zero.  If  the  number  of  right-going 
particles  is  the  same  as  those  going  to  the  left  at  time  t- 0,  then  w2  =  0  and  Eq.  (1)  reduces  to  the 
simpler  equation 


E>,  =  Dxw  | ,  (3) 

where  DX=(EX+E~l)l 2  is  the  discrete  averaging  operator.  The  averaging  operator  in  (3)  owes  its 
existence  to  the  presence  of  the  Laplacian  operator  in  the  continuous  diffusion  equation  dw}/dt 
=Dld2wi/ dx2  when  the  spatial  and  temporal  step  sizes  are  subject  to  the  condition  A=  V2 eDx.  As 
such,  most  of  the  well-posed  issues  that  pertain  to  the  continuous  case13  will  be  carried  over  to  the 
discrete  case.  In  particular,  Eq.  (3)  will  be  well  posed  with  two-point  Robin  type  of  boundary 
conditions  and  the  solution  will  exist. 

The  difference  equations  (1)  and  (2)  are  assumed  to  be  valid  in  the  region  0 <m<€  and  s 
>0  and  they  are  supplemented  by  an  initial  condition  at  ^  =  0  and  boundary  conditions  at  m 
=  0,€.  We  will  adopt  the  abbreviation  v(m,s )  to  denote  the  discrete  function  v(mA,se).  The 
boundary  conditions  we  are  interested  in  are  of  the  form 

Pj(0,s)  -  axpj{\,s)  =  0  and  pj(€,s)  -  oi2pj{t  -  l,s)  =  0,  j=  (4) 

where  the  constants  a1  and  a2  are  assumed  to  be  real  and  positive.  These  are  the  discrete  versions 
of  the  general  Robin  type  of  boundary  conditions  for  the  continuous  case.  The  case  of  purely 
absorbing  boundaries  at  m  =  0,€  is  characterized  by  cq  =  0,  i- 1,2,  while  the  purely  reflecting  case 
is  characterized  by  a{  -  1 ,  i=  1,2. 9,14  The  general  case  corresponds  to  partially  absorbing  and 
partially  reflecting  boundaries  with  different  degrees  of  absorption  at  the  two  ends.  Our  interest  is 
to  obtain  analytical  solutions  to  (1)  and  (2)  on  a  discrete  space-time  lattice  (m\,se)  subject  to  the 
boundary  conditions  in  (4).  In  contrast  to  the  diffusion  equation  (3),  it  is  not  clear  at  the  outset 
whether  a  solution  will  exist  for  (2)  under  the  boundary  condition  (4),  setting  aside  the  fact  that  it 
is  tied  to  the  Schrodinger  equation.  This  is  because  of  the  presence  of  the  spatial  shift  operators 
that  are  neither  symmetric  (as  in  the  operator  Dx )  nor  asymmetric  (as  in  an  operator  of  the  form 
VX=[EX-E~1]).  Recall,  for  instance,  that  the  diffusion  equation  with  a  drift  term,  whose  discrete 
counterpart  will  have  neither  a  symmetric  nor  an  asymmetric  spatial  operator,  will  not  always  have 
a  solution  even  with  Neumann  type  of  boundary  conditions.  However,  we  will  demonstrate  in  Sec. 
Ill  that  the  temporally  transformed  equation  corresponding  to  (2)  will  indeed  contain  the  averaging 
operator  and  the  existence  question  will  be  set  to  rest.  Because  of  the  linearity  of  Eqs.  (1)  and  (2), 
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a  convenient  solution  can  be  obtained  by  using  generating  function  and  integral  transform  tech¬ 
niques  as  outlined  in  Refs.  7  and  15. 

III.  SOLUTION  BY  GENERATING  FUNCTIONS 

In  the  following,  we  assume  complete  symmetry  between  the  right-moving  and  left-moving 
particles  so  that  w2  =  0.  Consider  a  function  v(mA,se)  and  its  temporal  transform  d(mA,z)  as 
defined  in  Ref.  7, 


v(mA,z)  =  2  v{mA,se)zs  =  Tv.  (5) 

5=0 

The  quantity  d(mA,z)  may  be  thought  of  as  the  discrete  version  of  the  Laplace  transform  of 
v  and  is  simply  referred  to  as  the  z-transform.  The  inverse  relation  is  defined  as 


v(mA,se) 


v(mA,z) 


z 


5+1 


dz  =  Tlv, 


(6) 


where  Cz  is  a  closed  contour  around  the  origin  in  the  complex  z-plane  that  encloses  only  the 
singularities  at  the  origin,  /=  V— 1,  and  the  symbol  T  denotes  the  temporal  transform.  The  trans¬ 
formed  variable  v(mA,z)  is  also  referred  to  as  the  generating  function  within  the  random  walk 
community.9  Applying  the  temporal  transform  to  (2)  and  (3)  and  making  use  of  the  shift  property 
of  the  T transform  (7[£’?u1]=z_1[u1(mA,z)-i;1(m,0)])  and  carrying  out  some  simplifications,  we 
arrive  at  the  following  equations  for  various  generating  functions  in  terms  of  the  initial  conditions: 


[1  -  zDx]wi(mA,z)  =  W](m,0), 


(7) 


[1  -  ^2zDx  +  z2]qi(mA,z)  =  qi(m,0)  - 


z 

-j^Ex[q2(m,0)  +  <?i(m,0)], 


(8) 


[1  -  \f2zDx  +  z2]q2(mA,z)  =  q2(m,0)  -  -^Exl[q2(m,0)  -  <7i(m,0)].  (9) 

The  characteristic  operators  that  appear  on  the  left  hand  sides  of  (7)-(9)  are  generic  to  the  diffu¬ 
sion  and  the  Schrodinger  equations  under  the  4RW  model  and  are  seen  to  be  completely  indepen¬ 
dent  of  the  boundary  conditions.  A  remarkable  feature  of  the  spatial  dependence  of  these  operators, 
which  is  not  entirely  evident  in  the  initial  Eq.  (2)  describing  the  transitional  probabilities,  is  that 
they  all  involve  only  the  averaging  operator  Dx  that  is  the  discrete  counterpart  of  the  Laplacian 
operator  in  the  continuous  case.  Such  a  relation  has  already  been  alluded  to  in  Sec.  II.  Both  the 
diffusion  and  the  Schrodinger  equations  contain  the  Laplacian  operator  as  far  as  the  spatial  vari¬ 
ables  are  concerned,  and  the  transformation  from  the  continuous  case  to  the  discrete  case  for  a 
given  order  of  accuracy  is  not  unique.  Employing  a  central  difference  formula  for  the  spatial 
operator  will  lead  to  Crank-Nicolson  type  of  discrete  equations,8  which,  like  the  4RW  model, 
result  in  a  spatially  second  order  accurate  schemes.  The  important  point  to  note  from  (9)  is  that  the 
unknown  variable  contains  only  the  averaging  operator  Dx  and  that  any  other  asymmetries  that 
arise  from  Ex  or  E~l  alone  are  contained  only  on  the  right  hand  side,  operating  on  the  known  initial 
conditions.  A  formal  solution  to  Eqs.  (7)-(9)  can  be  affected  by  using  the  inverse  relation  (6)  and 
evaluating  the  integrals  in  the  complex  z-plane  after  expanding  the  reciprocal  of  the  characteristic 
operators  in  a  Maclaurin  series.  [Recall  that  the  contour  integral  in  the  inverse  operator  in  (6)  is  a 
closed  loop  of  vanishing  size  around  the  origin].  The  procedure  is  similar  to  that  outlined  in  Ref. 
7  and  will  involve  Chebyshev  polynomials  of  the  second  kind  for  the  wave  functions  qx  and  q2 . 
The  result  is 


Author  complimentary  copy.  Redistribution  subject  to  AIP  license  or  copyright,  see  http://jmp.aip.org/jmp/copyright.jsp 


89 


053301-5  Transitional  probabilities  for  the  four-state  random 


J.  Math.  Phys.  50,  053301  (2009) 


w](m,s)  =  DsxW](m,0) , 


(10) 


qi(m,s)  =  U^^='jqt(m,0)  -  s_j^^Ex[q2{m,G)  +  q{(m,  0)], 


(ID 


q2(m,s)  =  Us 


D* 

A 


q2(m,0)  -  -\=U. 


JS~  1 


D x_ 

8 


E-x\q2(m,0)-qi(m,0)l 


(12) 


where  Us(x )  is  Chebyshev  polynomial  of  the  second  kind  of  order  s  and  argument  v.  The  formal 
solution  given  in  (10)-(12)  are  general  enough  and  are  valid  for  all  appropriate  boundary  condi¬ 
tions.  The  presence  of  the  operator  Dsx  in  the  diffusion  variable  wfm^s)  is  not  surprising  at  all. 
Indeed,  in  free  space,  (10)  directly  generates  the  characteristic  function  cos*  6  of  the  probability 
Wi  when  is  expanded  in  a  Fourier  series  with  transform  variable  0.  By  the  same  token, 

the  appearance  of  the  polynomials  Usf)  and  Us_f-)  is  intrinsic  to  the  Schrodinger  equation  in  the 
4RW  model,  as  already  indicated  previously.  Note  that  the  operators  Dx  (or  any  power  of  it)  and 
Ex  commute  and  the  order  of  these  terms  on  the  right  hand  sides  of  (11)  and  (12)  is  not  important. 
To  complete  the  solution,  we  must  now  expand  the  unknown  functions  in  terms  of  eigenfunctions 
of  the  Dx  operator  that  are  consistent  with  the  boundary  conditions  at  m  =  0,€.  In  free  space,  the 
appropriate  eigenfunctions  are  plane  waves  with  a  continuous  wavenumber  as  adopted  in  Ref.  7 
(or  said  in  other  words,  the  unknown  function  is  represented  in  terms  of  its  Fourier  transform  or 
series). 

For  the  boundary  conditions  indicated  as  in  (4),  we  seek  an  expansion  of  a  spatial  function 
v{m)  in  terms  of  exponential  and/or  trigonometric  functions.  An  exponential  function  of  the  form 
v0(m)  =  rm  is  a  valid  eigenfunction  provided  that  the  base  r=a\l  =  a2.  Clearly  this  is  only  possible 
in  the  special  case  of  ^ala2--=  ag=l,  where  ag  denotes  the  geometric  mean  of  a1  and  a2.  In  such 
a  case,  Dxu0(m)  =  0.5(a1  +  a2)v0(m)  :=  aa-v0(m),  where  aa,  being  the  arithmetic  mean  of  al  and 
a2 ,  is  the  eigenvalue  pertaining  to  u0(m).  When  a^l,  such  an  exponential  function  will  not  exist. 
We  will  denote  the  presence  of  this  exponential  function  by  employing  the  Kronecker  symbol  8la  . 
A  harmonic  function  of  the  form 


Uj(m )  =  Aj  sin (kjm)  +  Bj  cos (/ym),  7  =  1,2,...  (13) 

is  also  a  valid  eigenfunction  provided  that 

Bj(  1  -  a1  cos  kj)  =Ajax  sin  kj  (14) 

with  the  spatial  frequency  kj  given  by 

sin (kj£)  -  2 aa  sin[^(€  -  1)]  +  a2g  sin [kj(£  -  2)]  =  0.  (15) 

Equations  (14)  and  (15)  are  obtained  by  enforcing  the  boundary  condition  (4)  at  the  two  ends.  A 
trivial  solution  of  Eq.  (15)  is  kj= 0.  There  will  be  a  total  of  (€-1)  nontrivial  solutions  of  (15),  thus 
constituting  a  total  of  €  distinct  eigenfunctions  [including  the  function  to  represent  the 

solution  of  (9)  and  (12)  at  the  points  m= 0,  ...,€.  Making  use  of  (14)  in  (13)  allows  us  to  extract 
a  bare  eigenfunction  Vj(m)  (i.e.,  without  the  coefficient  Aj  and  other  common  factors)  in  the  form 

Vj(m)  =  sin  (kjm)  -  ax  sin  [kj(m  -  1)],  (16) 

with  the  spatial  frequency  set  by  (15)  for  a  given  aq,  a2 ,  and  It  can  be  easily  verified  that 
DxVj(m)  =  cos  kj  •  Vj(m)  so  that  the  eigenvalue  of  Vj(m)  with  respect  to  the  averaging  operator  is 
cos  kj.  Furthermore,  the  eigenfunctions  Vj{m)  with  distinct  kj  as  well  as  Vj(m)  and  u0(m)  are 
mutually  orthogonal,  i.e., 
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€-1 

2  Vi{m)vj(m)  =  0,  ij  =  1,  ...,€- 1,  i  ^  j, 
m=l 


(17) 


€-1 

2  Vj(m)v0(m)  =  0,  j=  1, ...  1. 

m=  1 


(18) 


The  following  normalization  results  can  also  be  readily  established  for  the  functions  v0(m)  and 
vj(m): 


€-1 

X  i>oM  = 

m=l 


-2(€-l)  _  i 


1-Off 


l/o0 


(19) 


and 


X  = 


sin  (&.€) 


m=l 


sin  kj 


ax  cos [kj(£  -  2)]  -  -(1  +  acf)cos[kj(£  -  1)] 


€(1  +  a\) 

+ - -  a cos  kj 


-  a\  sin2[^7(€  -  1)]  :=  1/dj.  (20) 

Gathering  all  of  the  above  results,  an  arbitrary  function  v(m)  satisfying  the  boundary  condition  (4) 
will  admit  a  spectral  representation  of  the  form 


€-1 

v(m)=A0v0(m)S1  +  X  AjVjim),  (21) 

7=1 

where  the  coefficients  A0  and  Aj  of  the  basis  functions  v0(m)  and  Vj(m)  can  be  obtained  in  terms 
of  the  function  v(m)  via  the  orthogonality  conditions  and  normalization  relations  (17)-(20), 


€-1 

A0  =  a0^  v0(m)v(m),  (22) 

m=  1 


€-1 

Aj  =  aj 2  Vj(m)v(m ),  j  =  1,  ...,€-  1.  (23) 

m=l 

With  this  spectral  representation,  it  is  clear  that 


€-1 

Dxv(m)  =  A0aa  •  u0(m)  ^  +  2  A;-  cos  kj  •  uy(m) .  (24) 

8  7=1 

Hence,  the  presence  of  Dx  in  the  spatial  domain  is  accounted  for  by  multiplying  the  spectral  basis 
function  term  by  its  respective  eigenvalue.  In  particular, 

€-1 

Dsxv(m )  =  A0asa  •  v0(m)  <5^+2  ^  cos*  kj  *  u/m)  (25) 

*  7=1 


and 


t/^julm)  =  /l(,t/s(^)  •  L.°(m)^+  X  '  vAm)-  (26) 

Having  laid  out  the  formulation  for  the  general  case,  we  will  now  consider  two  interesting  special 
cases  which  will  merit  a  separate  discussion. 
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A.  Totally  absorbing  boundaries 

In  this  case  a1  =  a2= 0,  which  precludes  the  exponential  solution  v0(m).  Equation  (15)  implies 
a  solution  kj=irj/£,  j=  1 , ,€- 1.  The  eigenfunctions  ^(m)  will  be  reduced  to  sin(7 rjm/€)  and 
cij=2/£  from  (20).  In  this  case,  one  gets  the  discrete  sine  transform16  representation  for  a  function 
satisfying  Dirichlet  boundary  conditions, 


€-1 

v(m)  =  2  A/  sin  I 
7=1 


Aj=~^j  u(m)sinl 


'  m=  1 


jirm 

— 


7=1, 


(27) 


B.  Totally  reflecting  boundaries 

For  totally  reflecting  boundaries  at  both  ends,  a1  =  a2=l,  which  dictate  that  ag  =  aa=  1.  Equa¬ 
tion  (15)  indicates  a  solution  kj=jn/  (€-1) ,  j=\ The  exponential  function  now  reduces 
to  a  constant  function  vf)(m)=  1.  The  normalization  constants  a0  and  aj  are  obtained  from  (19)  and 
(20)  as 


l/a0  =  ((  -  1),  l/aJ  =  2(€-l)sin2(^^y).  (28) 

An  unknown  function  v(m)  satisfying  perfectly  reflecting  conditions  at  the  two  ends  can  then  be 
expressed  as 


v{m)  =  A0  +  2  Ai  sin 
7=1 
€-1 

:=  A0  +  2  Cj  cos 


7Tjm 


€-1 

- 1) 

€-1 


.  /  7rj(m-l) 
■  sin 


€  -  1 


=  A0  +  2  2 A  .-  sin 


7=1 


nj 


2(€-l) 


cos 


-  {) 


€  -  1 


(29) 


with  the  coefficients  given  by 


2  €_1  2  €_1 

TT^W.  ^=——2  cos 

1  ~  1  m=  1  C  “  1  m=l 


KJ 


-  9 


€-1 


u(m),  y  =  l,  ...,€-  1. 


(30) 


Equations  (29)  and  (30)  constitute  the  discrete-cosine-transform  (Ref.  16)  representation  of  a 
function  satisfying  Neumann  type  of  boundary  conditions  at  the  end  points. 


C.  Solution  for  general  case 

The  results  given  in  (25)  and  (26)  will  now  be  used  to  determine  the  Green’s  function13  of  the 
diffusion  equation  (10)  and  the  Schrodinger  equations  (11)  and  (12).  The  linearity  of  the  governing 
equations  with  respect  to  the  initial  conditions  enables  the  solution  to  arbitrary  initial  conditions  in 
terms  of  this  Green’s  function.  To  this  end  we  consider  initial  conditions  of  the  form  PjJjn,  0)A 
=  PfJL 0<5^°,  l<m0<€-l,  where  E^=1Pm0=  1 .  This  initial  condition  corresponds  to  the  case  where 
the  particles  are  released  from  the  location  ra0  in  a  state  /z  with  probability  P^0.  Letting  Tj 
=  (JP10-JP30)/A  and  T2  =  (P20-P40)/ A,  it  is  dear  from  the  definitions  that  w1(m,0)  =  ^°, 
^1(m,0)  =  rl^°,  and  q2(m,0)  =  T2S^°.  Using  the  spectral  representation  given  in  (21)-(23)  for  the 
functions  qi(m, 0),  and  q2(m,0),  we  arrive  at 

€-1 

wi(m,0)  =  a0v0{m0)v0(m)Sla  +  2  ap  jim^v  j{m) ,  (31) 

*  h  i 
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€-1 


(him, 0)  =  fior i v()(m())v0(m) d'a  +  a-v j(m0)v Am) 


;'=i 


€-1 


q2(m,0)  =  a0T2v0(m,0)v0(m)S1a  +  T22  ajuAm^vAm). 


(32) 


(33) 


j=i 


Substituting  (3 1)— (33)  into  (10)  and  (11)  and  recalling  relations  (25)  and  (26),  we  arrive  at  the 
solution  for  the  general  boundary  conditions  as 


€-1 


wx(m,s)  =  a0alv0(m0)v0(m)Sla  +  2  aj  coss(kj)vj(mQ)vj(m) 


(34) 


7=1 


and 


q1(m,s)  =  a0v0(m0)S1a 


€-1 

+  2  CLjVjirriQ ) 
7=1 


X 


,  cos  k;\  ,  N  r2  +  r,  /cos/:/,  , 

x/2  / i  m  ~  ~^2rUs~i[~ir  \Vj{pi+l) 


(35) 


q2(m,s)  =  a0v0(m0)Sla 


=  ]v()(m)  -  —  Sl  US_A %=  Mm-  1) 


r2y„  ^ 


€-1 

+  2  ajVj(m0) 

j=  i 


X 


£ 


„  ,cosk:\  ,  r2-r,  cosk:,  , 

r,£/,|  — ^  k(m)  -  ^  Mm-  1) 


£  S-'V  £ 


(36) 


D.  Solution  for  totally  absorbing  case 

We  will  now  provide  some  numerical  results  for  the  special  case  of  totally  absorbing  bound¬ 
aries  at  the  two  ends.  In  this  case,  Eqs.  (34)-(36)  will  be  reduced  to 


.^-1 


2  v  .  /  77/ »?o \  .  /  JTjm\  TTj 

sm^— jcos 


(37) 


^1(m,^)  =  ^Ssin^^2j 
/ 


57 

C0S\  €  /  |  .  (  Trj in  'j 
^  - = —  ,cinl - 1 


£ 


'  \  €  / 


r2  +  r, 


77, 


5-1 


/  nj 

W  /  .  /  777  (m  +  1) 

sin1 


V2 


(38) 
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FIG.  1.  Comparison  of  analytical  solution  for  w1(mA,s€)A  with  that  obtained  from  counting  paths  in  random  walk 
simulations  for  totally  absorbing  boundary  conditions. 


q2(m,s) 


r2-r, 


U, 


s- 1 


Trj(m-  1)\ 
€  / 


(39) 


Because  the  Green’s  functions  satisfy  reciprocity  conditions,  it  is  permissible  to  interchange  m  and 
m0  in  the  above  expressions  without  changing  the  field  values.  The  solution  for  a  continuous  space 
can  be  obtained  by  carrying  out  the  same  limiting  process  as  outlined  in  Ref.  7.  For  example,  Eq. 
(37)  reduces  to  the  expression  for  the  probability  density  function  of  the  diffusion  process  with  a 
diffusion  constant  D  with  two  totally  absorbing  points  at  v=0  and  x-L  and  an  impulsive  initial 
condition  at  v=v0, 


p<x-‘> = zf  izr)’  m 

a  result  that  is  found  in  many  texts  including  Ref.  9.  The  results  given  in  (34)-(39)  are  exact,  and 
as  such,  no  validation  is  necessary.  Nevertheless,  it  is  interesting  to  compare  the  numerical  data 
they  generate  with  those  generated  through  direct  random  walk  simulations,  as  the  latter  will  more 
likely  be  employed  for  more  complicated  time-dependent  boundaries.  In  such  cases,  the  analytical 
results  developed  here  will  serve  more  as  a  validation  check  for  the  numerical  results  generated 
through  random  walk  simulations.  The  analytical  results  (labeled  “Ana”  in  the  figures)  and  the 
results  obtained  by  counting  the  fractional  number  of  paths  (labeled  “Num”  in  the  figures)  in  the 
4RW  simulations  with  initial  conditions  set  at  F,10=0.5  =  F,2o  from  the  location  m0  =  4  are  shown  in 
Figs.  1  and  2  at  ^=16  and  for  €  =  32.  For  reference,  the  solution  for  Schrodinger  equation  in  free 
space  is  also  shown  in  Fig.  2.  For  the  parameters  chosen  in  Fig.  2,  the  solution  with  boundaries 
will  differ  from  the  free-space  case  only  for  0<m<  12,  as  is  clearly  seen  in  the  figure.  A  large 
number  of  realizations  (about  108)  was  needed  to  arrive  at  numerically  converging  results,  par¬ 
ticularly  for  the  Schrodinger  equation  whose  solution  involves  difference  in  probabilities.  Both 
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FIG.  2.  (Color  online)  Comparison  of  the  exact  solution  of  Schrodinger  equation  with  that  obtained  through  counting  paths 
in  random  walk  simulations. 


figures  reveal  that  the  numerical  simulated  results  closely  mimic  the  analytical  formulas  derived 
here.  The  numerical  results  also  underscore  the  importance  of  a  good  numerical  random  number 
generator,  particularly  needed  for  large  s,  as  the  sample  size  grows  exponentially  with  s.  The  use 
of  entwined  paths  described  in  Ref.  17  is  a  possible  means  of  getting  around  this  difficulty, 
although  details  have  only  been  demonstrated  there  for  the  relativistic  case  of  bounded  particle 
speed. 

E.  Appropriateness  of  the  4RW  model  to  wave  propagation  problems 

It  might  be  worthwhile  to  comment  a  little  on  the  relationship  between  the  4RW  model  and 
the  continuous  parabolic  equation  for  which  the  former  is  being  targeted  in  numerical  computa¬ 
tions.  For  the  parabolic  equation  encountered  in  a  number  of  wave  propagation  problems  such  as 
in  underwater  acoustics,  radio  wave  propagation,  and  optical  wave  propagation  in  fibers,  the 
governing  equation  for  the  field  variable  ^  in  a  homogeneous  medium  with  time-harmonic  exci¬ 
tation  is  of  the  form 


dijj  i  d^ijj 
dt  2k0  dx2  ’ 


(41) 


where  the  independent  variable  t  denotes  the  axial  spatial  coordinate  and  the  variable  v  denotes  the 
lateral  spatial  coordinate,  k0=27r/X  is  the  wavenumber  in  the  medium,  and  X  is  the  wavelength  of 
the  time-harmonic  excitation.  Equation  (41)  describes  two-dimensional  wave  propagation  in  the 
t-x- plane  subject  to  the  approximation  that  all  waves  travel  within  an  angle  of  9=  ±  15°  about  the 
axial  direction.3  It  can  be  shown  that  the  maximum  step  size  A  in  the  lateral  direction  is  restricted 
by  A^  X/(2  sin  0max),  where  #max  is  the  maximum  angle  of  propagation  with  respect  to  the  f-axis. 
As  6  is  restricted  to  a  value  less  than  15°  for  the  parabolic  approximation  to  be  valid,  we  may  take 
sin  9max  ~  tan  #max~  A/  e.  We  then  get  the  approximate  relation 


776  ^  k0A2 .  (42) 

It  may  be  remarked  parenthetically  that  the  inequality  (42)  translates  to  the  condition  that  the 
Schrodinger  equation  is  valid  for  describing  particle  motion  for  nonrelativistic  particle  speeds  with 
the  normalized  speed  v/c^ tan  #max~0.27  for  #max=15°,  where  c  is  the  speed  of  light  in  free 
space.  In  the  4RW  model,  the  relation  between  the  step  sizes  of  the  form  6=k0A2  is  implied  and 
this  is  consistent  with  the  inequality  (42)  If  A  =  X/V2,  then  this  relation  implies  that  6=7rX.  Both 
of  these  values  are  well  within  the  maximum  values  permitted  by  the  parabolic  equation  approxi¬ 
mation  and  it  is  believed  that  the  4RW  model  constitutes  a  very  appropriate  discretization  scheme 
for  numerically  handling  the  parabolic  equation. 
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IV.  CONCLUSIONS 

Analytical  expressions  have  been  provided  for  the  transitional  probabilities  of  a  4RW  model 
on  a  lattice  constrained  in  space  with  dissimilar  boundaries  and  subject  to  partially  reflecting 
boundary  conditions.  Special  cases  of  perfectly  absorbing  boundaries  and  perfectly  reflecting 
boundaries  have  been  treated.  Solution  for  the  transitional  probabilities  evaluated  at  time  s  to  the 
diffusion  process  is  shown  to  involve  sth  power  of  the  averaging  operator  Dx ,  whereas  those  of  the 
Schrodinger  equation  involve  Chebyshev  polynomials  of  the  second  kind  of  order  s  and  s- 1  with 
argument  Dx/  ^2.  These  are  the  general  characteristics  of  diffusion  and  Schrodinger  processes  in 
the  4RW  model  irrespective  of  the  boundary  conditions.  Different  boundary  conditions  will  dictate 
different  choices  of  the  eigenfunctions  in  which  the  initial  probabilities  at  s  =  0  are  expanded.  The 
eigenfunctions  in  the  most  general  case  will  involve  exponential  function  as  well  as  harmonic 
functions.  The  exponential  function  will  only  exist  when  the  parameters  present  in  the  boundary 
conditions  satisfy  certain  relationship.  While  the  results  presented  in  this  paper  should  have  a 
significance  of  their  own  for  random  walk  with  dissimilar  boundaries,  it  is  hoped  that  they  will 
also  serve  as  benchmark  cases  for  numerical  stochastic  methods  designed  to  solve  more  compli¬ 
cated  situations.  Although  it  had  not  been  the  major  focus  of  the  current  paper,  numerical  imple¬ 
mentation  of  the  random  walk  solution  necessitates  the  availability  of  an  effective  random  number 
generator  to  sufficiently  populate  all  portions  of  the  sample  space.  This  is  particularly  critical  for 
field  evaluated  at  large  times.  Extension  of  these  results  to  higher  dimensions  and  to  situations 
with  a  potential  field  is  a  topic  worthy  of  further  study  and  will  be  taken  up  in  the  future. 
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Abstract — Domain  truncation  by  transparent  boundary  condi¬ 
tions  for  open  problems  where  parabolic  equation  is  utilized  to 
govern  wave  propagation  are  in  general  computationally  costly.  We 
utilize  two  approximations  to  a  convolution-in-space  type  discrete 
boundary  condition  to  reduce  the  cost,  while  maintaining  accu¬ 
racy  in  far  range  solutions.  Perfectly  matched  layer  adapted  to  the 
Crank-Nicolson  finite  difference  scheme  is  also  verified  for  a  2-D 
model  problem,  where  implemented  results  and  stability  analyses 
for  different  approaches  are  compared. 

Index  Terms — Crank-Nicolson  finite-difference  scheme,  discrete 
transparent  boundary  condition,  parabolic  equation,  perfectly 
matched  layer. 


I.  Introduction 

RADIOWAVE  propagation  governed  by  Helmholtz  equa¬ 
tion  can  be  approximated  by  parabolic  equation  (PE) 
under  certain  circumstances  if  the  spectral  content  of  waves 
is  narrow  around  the  propagation  axis  and  refractive  index 
inhomogeneity  of  the  atmosphere  is  smooth  [1].  Conventional 
narrow-angle  PE  approximation  of  wave  propagation  assumes 
maximum  ray  angle  to  be  within  ±15°  with  respect  to  the 
axis  of  propagation  (range).  The  main  distinction  between  the 
Helmholtz  equation  and  PE  is  the  reduction  of  2nd  order  deriva¬ 
tive  to  a  1st  order  derivative  along  the  range,  which  is  based 
on  ignoring  back- scattering  in  the  domain.  This  facilitates  a 
marching-in  range  technique  for  numerical  computation.  Most 
practical  PE  applications  are  concerned  with  far-range  wave 
behavior,  e.g.,  in  tropospheric  calculations,  where  the  grazing 
angles  are  already  very  small,  which  makes  the  error  due  to 
large  propagating  angles  affordable.  Another  application  of  PE 
is  propagation  prediction  in  tunnels  with  lossy  walls,  where 
the  wave  content  in  long  ranges  is  dominated  by  the  small 
grazing  angles  as  well  [2].  Two  schemes  are  available  for  the 
solution  of  PE,  first  of  which  is  the  split-step  Fourier  technique 
that  is  applicable  when  analytical  eigenfunctions  exist  for  the 
underlying  geometry.  Although  this  technique  is  numerically 
very  efficient,  it  is  inconvenient  for  boundary  modeling  [1]. 
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A  purely  numerical  scheme  (such  as  the  one  based  on  finite 
differences  (FD))  on  the  other  hand  is  applicable  for  more 
general  geometries  with  boundaries.  The  subject  matter  of  the 
current  paper  is  applicable  to  the  latter  and  Crank-Nicolson  FD 
scheme  is  assumed  to  be  employed  in  particular. 

Numerical  solution  of  wave  propagation  in  open  geometries 
requires  domain  truncation  at  a  designated  reference.  Thus  an 
absorbing  boundary  needs  to  be  placed  for  typical  PE  appli¬ 
cations.  Formulated  first  by  Berenger  [3]  for  Maxwell’s  Equa¬ 
tions  and  used  for  several  different  electromagnetic  problems, 
perfectly  matched  layer  (PML)  adapted  to  the  Crank-Nicolson 
scheme  is  one  way  of  domain  truncation  in  open  PE  problems. 
Collino  [4]  implemented  PML  for  a  variational  solution  to  PE, 
while  Levy  [5]  proposed  it  as  a  straightforward  truncation  for 
FD  and  split-step  Fourier  techniques  for  PE.  However,  there  are 
no  numerical  implementation  results  for  PML  adapted  to  FD 
schemes  of  PE  so  far.  The  first  goal  of  this  paper  is  to  provide 
some  numerical  comparison  results  for  PML,  when  adapted  to 
a  narrow-angle  PE.  A  question  that  arises  with  the  use  of  PML 
to  PE  is  how  effective  it  is,  given  that  the  PE  is  most  accurate  in 
the  region  of  validity  where  the  PML  is  most  reflective,  i.e.  for 
zero  grazing  angle. 

Domain  truncation  can  also  be  achieved  by  placing  trans¬ 
parent  boundary  conditions  (TBC)  and  there  are  two  approaches 
to  implementing  the  TBCs.  A  TBC  produces  zero  boundary 
reflections  into  the  geometry  it  is  defined  for.  Several  authors 
[1],  [6]  introduced  the  discretized  version  of  a  continuous  TBC. 
Reference  [7]  showed  that  this  approach  cannot  assure  uncon¬ 
ditional  stability  when  the  FD  discretization  does  not  match 
the  discretization  of  the  continuous  TBC.  It  can  also  be  shown 
that  this  boundary  condition  (BC)  is  not  reflection-free.  Alter¬ 
natively,  one  could  start  directly  from  the  Crank-Nicolson  FD 
discretization  of  PE,  done  by  Ehrhardt  and  Arnold  [7],  and  de¬ 
rive  numerically  exact  discrete  transparent  boundary  condition 
(DTBC),  that  involves  all  the  boundary  field  values  starting  from 
the  initial  plane.  For  example,  if  the  field  is  desired  at  the  1 ,000th 
range  step,  the  exact  discrete  BC  will  involve  convolution  of 
field  values  on  the  boundary  layer  at  all  the  previous  999  range 
steps.  Although  accurate,  DTBC  will  increase  the  CPU  time, 
particularly  for  long  ranges  and  there  is  a  need  for  considering 
approximate  BCs  that  are  local.  The  second  goal  of  the  paper  is 
to  propose  some  local  boundary  conditions  and  show  numerical 
comparisons  for  their  performance. 

The  first  localization  approach  to  DTBC  will  be  to  truncate 
the  boundary  layer  convolution  by  relatively  small  number  of 
terms,  and  utilize  for  convolution  not  only  the  boundary  layer 
values  but  also  some  already  computed  interior  field  values, 
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thereby  resulting  in  what  we  will  call  the  localized  DTBC 
(LDTBC).  This  is  achieved  by  employing  a  rational  approxi¬ 
mation  to  the  spectral  transfer  function.  The  second  localization 
is  also  in  the  form  of  a  rational  approximation,  namely  an 
approximation  by  partial  fractions  using  simple  poles  in  the 
complex  ^-transform  domain  [8].  Both  localizations  will  prove 
to  be  more  accurate  than  simple  truncation  of  the  boundary 
layer  convolution.  The  stability  analysis  for  the  first  approx¬ 
imation  will  be  carried  out  using  a  3 -layer  reduced  domain 
relying  on  pole  locations  in  ^-domain,  which  will  turn  out  to 
be  a  sufficient  check  for  the  stability  of  the  whole  geometry. 
Simple  pole  locations  in  ^-domain  will  determine  whether  the 
true  discrete  problem  is  stable  for  the  second  approximation. 

The  main  task  of  numerical  verification  and  simulation  of  dif¬ 
ferent  domain  truncations  for  the  discrete  PE  will  be  carried  out 
on  a  simple  model  problem,  i.e.  2-D  free-space  truncated  by 
the  absorbing  layer  of  interest  at  some  elevation  and  by  Perfect 
Electric  Conductor  (PEC)  as  terrain  ground  plane.  True  terrain 
may  be  uneven  which  will  tend  to  increase  the  grazing  angles 
of  waves  upon  reflection.  We  use  flat  PEC  terrain  for  simplicity, 
but  waves  of  larger  grazing  angles  are  included  by  modifying 
the  parameters  of  the  Gaussian  source.  Crank-Nicolson  scheme 
adapted  to  the  model  problem  is  formulated  in  Section  II-A, 
whereas  in  Section  II-B  the  PML  absorption  will  be  verified  for 
and  applied  to  the  problem.  The  exact  DTBC,  corresponding 
to  an  exact  transfer  function  and  its  Taylor  series  in  ^-domain, 
is  presented  in  Section  II-C.  The  two  approximate  localizations 
to  DTBC  with  stability  analyses,  implemented  results  for  the 
model  problem  and  efficiency  comparisons  will  take  place  in 
Sections  II-D,  II-E  and  III. 

II.  Theory 


x  PEC 


Fig.  1.  Computation  domain,  top  layer  being  absorbing  boundary  and  bottom 
layer  PEC. 

where  R  —  (2k0Ax)2 /k0At  is  a  unit-less  parameter.  Note  that 
field  values  at  half-integer  range  n  +  1/2  are  avoided  by  aver¬ 
aging  same  fields  at  n  and  n  +  1  and  this  scheme  is  of  second 
order  convergence  [11].  As  it  will  be  discussed  later,  the  solu¬ 
tion  to  this  system  of  equations  will  require  updating  by  two 
tri-diagonal  matrices  after  each  march-in  range. 

B.  PML  Implementation 

The  two-dimensional  PML  is  constructed  by  replacing  the 
height  x  with  complex  stretched-coordinate  x  [4]  given  by 

X 

x(x)  =  x  +  i  J  x(s)ds.  (3) 

0 


A.  Standard  PE 


The  standard  PE  in  the  reduced  variable  ip(x,t)  is 


dip 


i  d2ip 
2  kQ  dx 2 


+  ikQVip 


(1) 


which  is  obtained  after  narrow-angle  approximation  to  the 
Helmholtz  wave  equation  [9 ],i  =  I,  kQ  is  the  wave-number 
in  free  space  at  the  radian  frequency  w  and  V  is  the  modified 
refractive  index  of  the  medium.  Here  we  use  V  =  0  for  the 
simple  free  space  domain,  t  represents  the  range  coordinate 
variable  and  x  the  elevation  coordinate  variable  of  the  compu¬ 
tation  domain  depicted  in  Fig.  1.  We  denote  Xh  as  the  domain 
height  and  xt  as  the  elevation  at  which  the  excitation  will  be 
placed.  This  will  be  referred  to  as  the  mean  height  of  the  excited 
Gaussian  source  that  will  be  discussed  later  in  the  paper.  The 
more  general  case  of  non-zero  but  constant  V  for  x  >  Xh ,  can 
be  handled  by  making  the  transformation  <p  =  ^pezk°vt  in  the 
end  result  as  in  [10]. 

Utilizing  the  discrete  notation  ip(jAx,nAt)  =  ip™  and  ex¬ 
panding  central  differences  around  discrete  range  n  +  1  /2  for 
the  t  derivatives  in  (1),  the  Crank-Nicolson  discretization  for  (1) 
is 


=  ^(R-2i)  +  i(^_1+^+1)  (2) 


We  use  a  parabolic  profile  for  the  normalized  conductivity  a 
(unit-less) 

(jttjc)  —  /  —  Xh)  ,  X  >  Xh 

\o,  X<xh 


where  r\0  is  the  wave  impedance  in  free  space  and  a0  is  the  true 
conductivity  (S/m).  Recall  that  the  product  g0t]0  has  units  m_1 
thus  a(x)  remains  unit-less.  The  coordinate  transformation  in 
(3)  will  be  stable  for  the  Sommerfeld  radiation  condition,  since 
an  e~tWT  time  convention  in  time  r  is  used.  The  standard  PE  in 
(1)  in  the  stretched-coordinates  becomes 

dip  i  1  d 

dt  2 kQ  1  +  ia(x)  dx 


d 


1  +  ia(x)  dx ^ 


(5) 
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with  a(j Ax,t)  =  becomes  [11] 
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Note  that  aQ  =  0  basically  reduces  (6)  to  (2)  (that  governs 
the  domain  in  Fig.  1  without  PML  above).  The  quadratic  de¬ 
pendence  of  a(x)  on  height  x  given  in  (4)  and  the  associated 
wave  absorption  provides  the  freedom  to  place  a  PEC  on  top  of 
the  PML,  since  the  rays  in  the  layer  experience  a  controlled  loss 
twice  as  they  reflect  back  into  the  domain.  The  PML  of  thick¬ 
ness  8,  a  few  wavelengths  above  Xh  is  backed  with  a  PEC.  We 
have  control  over  aQ  and  8  to  meet  a  desired  reflection  coeffi¬ 
cient  T.  The  reflection  coefficient  from  the  PML  for  a  ray  with 
paraxial  angle  6  is  [3],  [4] 

r(0)  =  —  exp  [— %2k0  sin  6x(xh  +  5)].  (7) 

Lor  the  parabolic  profile  this  results  in  an  equation  for  the  true 
conductivity  in  terms  of  the  desired  reflection  coefficient  as 


Fig.  2.  Branch  cut  on  2 -plane  for  \v(z)\  =  1,  R  —  0.63.  Cz  is  the  inversion 
circle  around  origin. 


-3|lnT(eo)| 

2 k2  sin  0or]o8 3  * 


(8) 


One  aspect  to  note  about  reflection  is  that,  it  is  smaller  for 
wider  angle  0,  which  leads  to  the  fact  that  PML  simulates  a 
better  absorption  for  waves  propagating  at  wider  angles  than 
those  at  shallower  angles  [1].  The  reflection  coefficient  is  one 
in  magnitude  for  0  =  0.  That  is  why  aQ  is  chosen  by  setting 
the  reflection  T  for  a  small  grazing  angle,  i.e.  a  small  0o,  so  that 
higher  angle  content  will  reflect  even  less  back  into  the  domain. 
One  restriction  on  layer  thickness  8  is  that  it  is  not  desirable  to 
set  it  too  high,  since  it  will  increase  the  matrix  sizes  for  each 
marching-in  range  computation.  Computation  of  (6)  obviously 
involves  two  tri-diagonal  matrices  to  update  the  field  vector  after 
each  marching  in  range,  and  entries  of  both  matrices  are  con¬ 
stants.  Therefore,  the  matrix  equation  representation  of  (6)  for 
the  domain  in  Lig.  1  is  of  the  form 


The  inversion  contour  Cj  is  counter-clockwise  as  indicated  in 
Lig.  2.  Also,  as  in  [7],  ^  =  0  is  assumed  for  j  >  J  —  2.  Taking 
the  ^-transform  on  both  sides  of  (2)  results  in 


(1  +  z)Um  (z)  +  [(1  —  z)iR  —  2(1  +  z)\  Uj(z)+ 

(1  +  z)Uj-1(z)  =  0  (11) 


where  j  >  J—  1 .  More  specifically,  the  transfer  function  relating 
field  on  the  boundary  layer  in  ^-domain  to  the  field  on  the  layer 
just  below  it  is 


v{z)  = 


Uj-i(z) 

Uj(z) 


=1  —  i 


R  l  —  z 
JT+z 


.R  1- 


2  1+z 


Rl-z\ 

ll+z) 
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S^n+1  =  Tf1.  (9) 

The  length  of  the  vector  is  J  — 1  +  5/  Ax  and  since  we  need 
half-integer  indices  of  a(x)  in  (6),  we  discretize  the  conductivity 
two  times  finer  than  we  do  the  field 

C.  DTBC  Derivation 

We  will  now  derive  and  approximate  the  DTBC  directly  for 
the  Crank-Nicolson  scheme.  The  original  derivation  of  DTBC  is 
given  in  [7] .  However,  we  derive  a  newer  form  that  is  amenable 
to  approximations.  Solving  the  discrete  PE  on  and  above  the 
boundary  layer  while  assuming  a  decaying  nature  of  the  fields 
above  this  layer  results  in  [7] 

n  n 

E  ^ru + E  =  °>  3>  j-  do) 

u= 0  v=0 

nu  and  \iv  are  weights  of  convolutions  on  a  layer  j  and 
on  the  layer  j  —  1,  below  it.  Such  a  convolution-type 
relation  of  fields  leads  us  to  use  ^-transforms,  which 
translates  the  relation  of  field  values  on  successive  layers 
on  or  above  the  boundary  layer  to  a  polynomial  in  the 
complex  z-domain.  We  will  define  the  ^-transform  as 
=  Uj(z)  :=  V;j^n  where  \z\  <  1  and  the 

inverse  ^-transform  as  ^  =  (1/27 vi)  §c  Uj(z)z~n~1dz  [10]. 


The  transfer  function  v(z)  in  general  is  multi-valued,  there¬ 
fore  the  operator  above  is  defined  to  ensure  \v  (*)i  >  1. 
which  reflects  decaying  nature  of  Uj(z)  for  j  >  J  —  1.  Let 
/  denote  a  modified  transfer  function  defined  as 


f{z)={l  +  z)v{z) 

=  (1  +  z)  —  2i(l  —  z)  tan  aQ 
—  2  tan  aQ  \J —ie~ioL°  csc<a0 
x  \/—z2e2ia°  +  2izsma0e'ia°  +  1  (13) 


with  tan<a0  =  R/ 4.  We  introduce  a  new  variable  (  =  —ize%OL° 
and  take  the  first  derivative  of  (13).  This  is  so  that  the  resulting 
function  1  / sj (2  —  2sum0£  +  1  can  be  expressed  in  terms  of 
Legendre  polynomials  as  J]m=o  Cm^m(snm0)  where  Pm(.) 
are  the  Legendre  polynomials.  The  derivative  of  /  with  respect 
to  C  is 


/'(C)  =  A  +  B 


C  —  sin  aQ 

\/C2  -  2  sin  aQ(  4- 1 


(14) 


where 


.  ,  .  f  1  +  sin2  ol0 

A  =  —  sm  aQ  +  x  I  - 

\  cos  aQ 

B  —  —  2 i \J tan2  aQ  +  i  tan  aQ . 


(15) 
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Using  the  Legendre  function  representation  of  the  quantity 
under  the  radical  sign  gives 

oo 

/'(C)  =  A  -  B  sin  a0  E  (mPm(srna0) 

m= 0 

co 

i(sina0)  (16) 

m= 0 

with  P_ i(.)  =  0.  The  Taylor-series  expansion  of  f'(()  can  be 
written  as 


no  =  E  a?) 

m= 0 

with  coefficients 

Co  =  A  —  B  sin  a0P0{  sin  aQ ) 
cm  =B  [Pm_i(sino:0)  -  sina0Pm(sina0)] 
m  — 1,2,...  (18) 


As  already  indicated  the  multi-valued  yC  operator  in  (12)  is 
defined  such  that  |/(0) |  =  |zy(0)|  >  1.  Using  (17),  the  modified 
and  exact  transfer  functions  can  finally  be  written  as 


and 


/(c)  =  -  E  an 

m= 0 

ao=  -  /( 0) 

Cm  —  1 


— 


m 


,  m  =  1,  2, . . . ,  oo 


f(z)  E  7m*" 

u{z)=pn=_r n=£ - 

V  '  l  +  Z  1  +  3 


(19) 


(20) 


with  7m  =  (— i)rneirna°arn.  The  region  of  convergence  of  the 
series  depends  on  the  singularities  of  v(z).  This  leads  to  the 
investigation  of  properties  of  the  exact  transfer  function  /  in 
z-plane.  The  branch  cut  in  z-plane  for  the  function  given  in  (12) 
is  depicted  in  Fig.  2,  as  a  bold  dashed  curve  separating  the  two 
sheets  with  \v(z)\  =  1  on  it.  It  can  be  shown  that  the  branch 
points  are  at  zo  =  1  and  z\  —  (R  +  4 i)  /(R  —  4 i).  The  point  z\ 
in  general  could  be  in  either  of  1st  or  2nd  quadrants  depending 
on  R. 

There  is  a  practical  reason  why  (12)  or  (20)  is  not  suitable 
for  direct  use  in  the  Crank-Nicolson  scheme.  Because  we  are 
interested  in  a  bounded  computation  domain  that  starts  at  range 
t  =  0,  the  infinite  summation  in  (20)  reduces  to  a  convolution 
of  size  N  =  t/ At  where  t  is  the  range  of  the  present  marching 
step.  The  upper  limit  in  (20)  will  be  referred  as  being  N  hence¬ 
forth.  This  is  usually  a  large  number,  especially  for  fine  dis¬ 
cretizations  and  far  ranges.  To  have  an  idea  of  how  this  transfer 
function  affects  the  boundary  computation  in  the  spatial  domain 
and  how  ineffective  the  convolution  is,  the  nodes  used  in  con¬ 
volution  are  depicted  in  Fig.  3.  There,  the  boundary  is  at  Jth 
discrete  layer  and  all  the  nodes  on  that  layer  are  involved  in  the 
first  summation  in  (10).  The  two  nodes  on  J  —  1st  layer  con¬ 
tribute  to  the  second  summation  in  (10),  i.e.  only  the  first  two 


Fig.  3.  Exact  DTBC  convolution  stencil.  The  two  layers  of  nodes  correspond 
to  the  two  convolutions  in  (10).  This  stencil  is  valid  at  all  altitudes  greater  than 
J  Ax. 


terms  are  non-zero  in  the  second  summation.  This  is  because  of 
the  second  degree  polynomial  in  the  denominator  of  v{z). 

D.  LDTBC  Approximation 

The  first  approximation  we  propose  is  replacing  the 
length-7V  +  1  summation  in  (20)  by  a  Pade  approximant 
of  order  P/Q, 

E  duZU 

m  *  —  (2D 

E  evZV 

v=0 

where  du  ’  s  and  e^’s  are  determined  by  conventional  Pade  ap¬ 
proximant  procedure  [12].  The  Taylor  series  expansion  derived 
in  (20)  is  very  convenient  in  this  regard.  We  will  set  the  leading 
denominator  coefficient  eG  =  1  for  convenience.  The  relations 
(20)  and  (21)  result  in  v(z)  also  in  a  rational  form 

f(z)  ?  duZW 

/  \  J  V7/  u — 0 

- ;  <22) 

E  9vZv+1 

v=  —  l 


where  gv  =  ev  +  ev+i  for  v  =  0, 1, . . . ,  Q  -  1,  gQ  =  eQ  and 
9-1  =  eQ  =  1. 

The  transfer  function  v{z)  in  (22)  is  plotted  in  Fig.  4  for  z  — 
0.9e^°,  6  =  [0,  27 r).  It  should  be  stressed  at  this  point  that  the 
Pade  approximation  above  is  obtained  by  enforcing  continuities 
at  the  origin  in  ^-domain,  thus  an  approximation  of  order  P/Q  is 
less  valid  at  points  closer  to  the  unit  circle  than  near  the  origin. 
Points  on  \z\  =  0.9  circle  are  utilized  above  for  the  sake  of 
demonstrating  severity  of  the  approximation  (the  approximation 
will  be  worst  for  \z\  =  1).  It  is  seen  that  an  approximation  of 
higher  order  is  always  favorable  and  that  an  approximation  of 
order  P  =  10/Q  =  4is  good  enough  to  mimic  the  exact  transfer 
function  for  this  case.  To  appreciate  the  effect  of  using  interior 
domain  points,  i.e.  on  one  layer  below  the  absorbing  layer,  the 
coefficient  magnitudes  for  the  two  cases,  Q  —  0  case  and  Q  >  0 
case,  are  shown  in  Fig.  5  for  the  same  P  value.  Clearly,  the 
dominance  of  low  order  terms  in  vector  d  against  higher  order 
terms  in  it  is  much  more  significant  for  approximations  with 
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Fig.  5.  Pade  coefficient  magnitudes  of  different  LDTBC  approximations,  R  — 
0.63.  d  and  e  are  respective  vectors  of  numerator  and  denominator  coefficients 
of  the  corresponding  approximation  in  each  case. 


higher  Q.  In  other  words  to  realize  a  given  accuracy,  a  smaller 
P  is  needed  with  Q  —  12  than  with  Q  —  8,  which  will  result  in  a 
smaller  convolution  in  boundary  terms.  More  simulation  results 
for  different  P/Q  pairs  are  shown  in  Section  III. 

Transforming  from  u(z)  in  (22)  back  to  the  spatial  domain 
through  inverse  Z- transform,  the  boundary  value  at  arbitrary 
range  index  n  is  determined  in  terms  of  already  computed 
boundary  values  (convolution  of  length  P  +  1)  and  values 
on  the  uppermost  computation  layer  (convolution  of  length 
Q  +  2).  Inverse  Z-transform  of  (22)  gives  the  boundary  value 
at  arbitrary  discrete  range  nAt ,  n  —  1,2,.  ..,7V  =  t/ At,  as 


rj  =  - 


i 

d0 


p 


_u= 1 


Q+l 

+  E^=i 

?;=0 


(23) 


The  matrix  representation  of  (6)  with  an  absorbing  boundary 
at  the  top  and  PEC  boundary  at  the  bottom  will  be  of  the  form 


(24) 


where 


S  = 


T  = 


\-R  +  2i 
—i 
0 


VR-2i 
i 
0 


R  +  2i 

—i 


R  —  2i 
i 


R  +  2i 

0 

0 

i 

R-2i 


-l  8r. 

0  . 

i  0 


(25) 


(26) 


L  .  .  o 

sc  =  R  +  2i  +  i^- 
do 

tc  =  R  —  2i  — 

d0 


and  for  j  =  1,2 ,J  —  1,  Q  >  0, 


(27) 

(28) 


n—v-\- 1 
J- 1 


(29) 

The  unconditional  stability  of  Crank-Nicolson  scheme  in  free 
space  is  well  known  [11].  However,  when  the  exact  transfer 
function  (20)  is  approximated  as  in  (22),  the  scheme  is  not  un¬ 
conditionally  stable  anymore  and  it  may  not  be  trivial  to  derive 
a  stability  condition  for  a  given  geometry  and  discretization.  In¬ 
stead  we  study  the  reduced  geometry  depicted  in  Fig.  6,  i.e.  for 
a  3  layer  problem — the  top  layer  being  absorbing  boundary,  the 
mid-layer  being  the  computation  domain  and  the  bottom  layer 
being  the  PEC.  Although  we  do  not  prove  that  stability  of  this  re¬ 
duced  geometry  leads  to  stability  of  the  larger  domain  in  Fig.  1, 
it  still  provides  a  stability  check  since  the  instability  comes  only 
from  associated  approximate  boundary  conditions.  The  excita¬ 
tion  we  use  in  this  case  is  a  point  source  of  magnitude  A,  located 
in  the  middle  layer,  i.e.  at  j  =  J  —  1  =  1.  Since  an  impulse  in 
spatial  domain  will  have  components  in  all  angular  spectra,  such 
an  excitation  is  a  worst-case  test  for  the  narrow-angle  PE.  For 
this  small  geometry,  (2)  reduces  to 


(R  +  2 i)^+1  -  *V>2+1  =  (R-  2*)^r  +  2  (30) 


where  =  0,  n  =  0, 1, ...  is  enforced  by  the  PEC  bottom 
layer.  Recalling  ^  =  A,  the  ^-domain  version  of  (30)  becomes 

(R  +  2i)z-1U1(z)-A(R  +  2i)z-1-iz~llAA 

VyZ) 

=  {R—  2i)U\{z)  +  i-Ay  (31) 
V\Z) 

where  Uj(z )  =  j  —  1,  2  and  v[z)  —  U\{z)/U2(z). 

Furthermore,  substitution  of  (22)  for  v(z)  gives 

p 

U1{z)  =  AYjPZ-  (32) 

UZ~ZI 


ri  being  residues  and  zi  poles  of  the  function.  Equation  (32)  is 
true  if  P  >  Q.  This  is  always  the  case  here,  because  P/Q  pairs 
were  obtained  through  truncating  a  very  long  convolution  by  P 


St/)n+1  =  T  ipn  +  iWn 
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Fig.  6.  Reduced  geometry  to  study  the  approximation  stability. 
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Fig.  7.  Inverse  pole  locations  1  / zi  for  reduced-domain  LDTBC  solutions  on 
complex  Z -domain,  l  —  0,1,.  . . ,  P.  Stars  are  for  the  unstable  case  and  in¬ 
verted  triangles  are  for  the  stable  case. 
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terms  and  padding  new  terms  to  a  length-2  convolution  (revisit 
Fig.  3).  Transforming  (32)  back  to  spatial  domain  gives 

p 

W  =  Z-1{U1(z)}  =  A'£/rlzfn-1.  (33) 
1=0 

It  is  sufficient  for  the  poles  zi  of  the  system  to  all  lie  outside 
the  unit  circle  for  stability  (or  each  1  /  z\  should  lie  inside  the 
unit  circle).  Fig.  7  depicts  two  cases,  where  the  approximation 
is  stable  in  one  case  and  unstable  in  the  other. 

One  point  to  emphasize  about  this  stability  analysis  is  that  it 
may  not  always  be  trivial  to  find  a  stable  P/Q  pair  for  every 
discretization  Ax  and  At,  especially  if  P  and  Q  are  desired  to 
be  significantly  large. 

E.  Approximation  by  Partial  Fractions:  LDTBC2 

LDTBC  formulated  above  introduces  tolerable  inaccuracy 
while  avoiding  a  convolution  involving  all  boundary  values. 
However,  the  numerical  results  for  quite  long  ranges  will  show 
that  a  large  order  P/Q  pair  will  have  to  be  used  in  LDTBC  ap¬ 
proximation.  The  immediate  question  of  how  easy  is  it  to  find  a 
stable  P/Q  pair  for  moderate  orders  comes  up.  Moreover,  such 
a  stable  LDTBC  approximation  still  requires  two  convolutions 
at  each  march-in  range,  i.e.  one  on  boundary  layer  values  of 
order  P  +  1  and  another  of  order  Q  +  2  on  one  layer  below  the 
boundary.  This  may  be  undesirable. 

A  second  approximation  to  the  exact  and  modified  transfer 
functions  in  (19)  is  still  in  the  form  of  a  Pade  approximant,  but 
of  order  [L/(L  +  1)].  This  case  has  been  proposed  in  [8]  and 
corresponds  to  approximation  by  partial  fractions  with  L  +  1 


simple  poles  in  the  ^-domain,  assuming  they  all  lie  outside  the 
unit  circle  (to  assure  stability).  The  polynomial  corresponding  to 
the  spatial  boundary  layer  convolution  in  (20)  is  approximated 
as 

M — 1  L  h 

(34) 

m= 0  1=0  Z  1 


Namely,  the  approximation  is 


n—M 

m= 0 


n—M 

Y,  7 m+MZ™ 

m= 0 


E 

1=0 


bi 


z  -  hi 


(35) 


We  retain  the  original  coefficients  for  the  first  M  terms  so  that 


7m 


7m? 

+  Yj  h-M  +  m  + 1 

1=0  1 


m  =  0, 1, . . . ,  M  —  1 

m  >  M 


(36) 


with  M  >  1  and  \hi\  >  1,  /  =  0, 1, . . . , L.  The  standard 
Pade  approximant  that  gives  unique  set  of  hi  s  involves  a  (L  + 
1)  x  (L  +  1)  linear  system  to  solve  [12]  and  b{  s  are  deter¬ 
mined  by  back-substitution;  thus  7m  =  7m  is  satisfied  for  m  = 
0,1,...,2L+M+1.  The  higher  order  approximate  coefficients 
given  by  (36)  are  desired  to  mimic  exact  7m  at  as  many  points  as 
possible,  and  the  quality  of  the  approximation  at  orders  higher 
than  2L  +  M  +  1  will  be  the  deciding  factor  for  choosing  L.  A 
scheme  with  very  large  L  is  however  prone  to  instabilities  due  to 
numerical  roundoff.  The  stability  condition  of  this  approxima¬ 
tion  is  directly  given  by  the  system  pole  locations,  i.e.  |  hi  \  >  1  is 
necessary  for  stability.  However  the  original  function  will  have 
branch  point  singularities  at  \z\  =  1  as  already  demonstrated  in 
Fig.  2,  this  implies  that  the  approximation  could  be  marginally 
stable  at  best.  Any  LDTBC2  solution  that  turns  out  to  be  un¬ 
stable  is  expected  to  possess  almost  all  of  its  poles  in  the  vicinity 
of  the  unit  circle  but  some  just  inside.  In  other  words,  when  ap¬ 
proximate  f(z )  is  expanded  by  L  +  1  partial  fractions,  all  or 
most  of  the  poles  of  the  solution  are  outside  the  unit  circle,  the 
rest  are  very  close  to  and  inside  the  unit  circle  if  any. 

Practical  calculations  reveal  that  the  LDTBC 2  approxima¬ 
tion  with  more  than  30-to-40  simple  poles  (depending  on  R ) 
turn  out  to  be  unstable.  Approximation  with  fewer  poles  on  the 
other  hand  cannot  ensure  the  approximate  coefficients  in  (36) 
to  mimic  high  order  exact  coefficients.  Such  an  approximation 
results  in  inaccuracy  in  long-range  simulations.  For  instance, 
LDTBC2  approximation  of  order  L  >  100  is  necessary  for 
7m  to  accurately  mimic  7m  in  (36),  m  =  0, 1, ... ,  2000  for 
the  given  R  =  0.63.  The  poles  of  the  LDTBC2  approximation 
that  are  inside  the  unit  circle  for  this  case  are  depicted  in  Fig.  8. 
Furthermore,  given  an  unstable  LDTBC2  approximation  with 
given  number  of  poles  and  an  R  parameter,  LDTBC2  approxi¬ 
mation  with  more  poles  for  the  same  R  is  also  another  unstable 
approximation.  Hence  appropriate  pole  location  modifications 
are  necessary  for  the  sake  of  stability.  Because  the  poles  making 
the  approximation  unstable  are  close  to  the  unit  circle,  inverting 
their  magnitudes,  while  their  arguments  kept  unchanged,  results 
in  a  new  stable  approximation  with  undetermined  residues.  The 
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Fig.  8.  The  poles  of  LDTBC2  approximate  solution  lying  inside  unit  circle 
in  the  case  of  L  —  100,  M  —  0  and  R  —  0.63. 


way  to  set  new  residues  for  the  “re-located”  poles  relies  on  en¬ 
forcing  continuity  of  the  exact  transfer  function  and  its  deriva¬ 
tives  at  $  =  0,  up  to  the  order  to  give  a  linear  system  to  uniquely 
determine  these  new  residues.  This  way  of  stabilizing  LDTBC2 
is  summarized  as  follows. 

•  LDTBC2  with  L  + 1  partial  fractions  (Pade  approximation 
of  order  [L/L  +  1])  is  applied  to  approximate  the  exact 
solution,  B  of  the  simple  poles  lying  inside  the  unit  circle. 

•  If  B  /  0,  meaning  the  approximation  is  unstable^Jhe 
poles  inside  are  pushed  out  of  the  unit  circle  through 
hk/\hk\ 2,  k  =  0, 1, . . . ,  B  —  1.  Note  here  that  hk  and  hk 
are  reordered  for  convenience. 

•  f(y\o)  _  =  {d»/dzv)\z£0B(bl/z-hl)  +  Y,Li 

(bk/z  —  hk)\z= 0  is  enforced  for  y  =  0, 1, . . . ,  B  -  1 
giving  unique  solution  of  new  residues  bk  corresponding 
to  re-located  poles  hk .  Here  hi  are  also  reordered. 

Although  the  two  are  in  the  same  rational  form,  LDTBC2, 
providing  recursive  computation,  is  superior  to  LDTBC. 
Namely  there  will  not  be  a  whole  new  boundary  layer  con¬ 
volution  at  each  march-in  range.  Instead,  the  history  on  the 
boundary  layer  will  be  cumulative,  thus  could  be  recursively 
computed  by  adding  a  new  term  after  each  march-in  range.  The 
approximation  in  (35)  translates  in  the  spatial  domain  as 

n  M  —  1  L 

E  *  ^2  7m rm  +  52  D^n  -  M)  ^37> 

m= 0  m=0  1=0 

where 

Dt(s)  =  {ht^J  +  hD^s  -  'f  s  >  0  (38) 

W  \o,  5  <  0.  ' 

The  convolution  of  order  M  in  (37)  is  to  be  computed  at  each 
range  step;  on  the  other  hand  Di  are  updated  at  each  step  recur¬ 
sively,  that  results  in  the  boundary  layer  value  at  discrete  range 

n 


rj=- 


1 

7o 


~M — 1  L 

Ewr+E^(n-M)+^  1+^-1 


|_m=l 


1=0 


(39) 

The  reason  for  keeping  the  first  M- term  convolution  and  not 
associating  it  in  the  approximation  is  revealed  in  the  nature  of 


7m  coefficients  for  small  m.  The  low  order  terms  of  the  Le¬ 
gendre  polynomials  with  specific  arguments  make  the  first  few 
coefficients  very  large  compared  with  higher  order  coefficients 
[8].  This  is  why  the  first  M  7 m  are  set  to  be  equal  to  7m.  This 
makes  the  dynamic  range  of  the  coefficients  that  rational  ap¬ 
proximation  is  enforced  on  smaller,  resulting  in  a  more  accurate 
approximation  for  orders  higher  than  2L  +  M  +  1.  The  fact  that 
the  first  few  coefficients  are  very  large  compared  with  higher 
order  coefficients  is  depicted  in  Fig.  5,  where  d  reduces  to  7  in 
the  case  of  simple  convolution  truncation  (Q  =  0  case).  Choice 
of  M  =  2  will  improve  the  coefficient  approximation  to  an  ex¬ 
tent  where  it  cannot  be  pushed  further,  due  to  the  fact  that  70  and 
71  are  those  big  coefficients  making  the  dynamic  range  of  coeffi¬ 
cient  magnitudes  huge  [8].  The  dynamic  range  of  7  in  Fig.  5  (\d\ 
in  blue)  will  be  more  severe  for  smaller  R ,  thus  makes  the  need 
to  shift  the  approximation  termination  by  M  terms  inevitable. 


III.  Numerical  Results 


Numerical  results  for  the  Crank-Nicolson  FD  scheme  out¬ 
lined  above  for  LDTBC  and  LDTBC2  as  well  as  the  PML  are 
compared  in  this  section.  As  mentioned  previously,  the  initial 
domain  truncation  enforces  ^  =  0,  j  >  J  —  2  where  the  ab¬ 
sorbing  boundary  is  placed  at  Jth  layer.  We  generate  a  Gaussian 
source  with  a  standard  deviation  <rx  and  centered  at  height  xt,  by 
considering  an  infinite  sum  of  eigenfunctions  of  an  underlying 
geometry  (parallel  plate  waveguide  with  PEC  walls  at  x  =  0 
and  x  =  Xh)-  The  approximate  Gaussian  function  is  obtained 
by  retaining  only  the  first  K  number  of  eigenfunctions 


K 

t  =  0)  =  A  sin 

m=l 


rmcxt 

Xh 


.  TfVKX  _m2  2 

sin - e 

Xh 


1/2*1 


(40) 

The  standard  deviation  ax  is  chosen  so  that  the  effective 
beam-width  remains  well  within  the  PE  approximation.  The 
solution  of  the  standard  PE  in  (1)  at  a  range  t  for  the  excitation 
in  (40)  and  a  PEC  boundary  at  x  =  0  could  be  shown  to  be 


^(x,  t)  =  —  A 
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Esin 

m=  1 


yyye-%&he~ 

Xh 


2; 


.2  2 

,2 
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where  B{x)  =  f*  e^O/2)*2  dt  is  the  Fresnel  Integral  and 


1  /  j kQx 2  tm27r2  \ 

y  V  t  y  kQx\  J  * 


(42) 


Note  that  there  is  no  PEC  boundary  at  x  =  Xh  for  t  >  0. 
The  model  geometry  (2-D  free  space)  is  truncated  at  Xh  =  50A 
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Fig.  9.  Field  magnitudes  (V/m)  at  range  t  =  10,  000A,  with  ax  —  1A,  xt  — 
x hJ 2  and  K  —  400  for  the  excitation.  The  dashed  DTBC  solution  curve  is 
indistinguishable  from  the  solid  analytical  solution  curve. 


Fig.  11.  Field  magnitudes  (V/m)  at  range  t  —  10,000A.  Simulation  parame¬ 
ters  are  the  same  as  in  Fig.  9. 


Fig.  10.  L2-norm  errors.  The  dashed  curves  show  LDTBC  errors  for  varying 
P.  Straight  solid  lines  with  squares,  pentagrams  and  circles  denote  error  levels 
for  other  numerical  solutions.  Simulation  parameters  are  the  same  as  in  Fig.  9. 


above  the  ground  plane.  This  deliberate  choice  of  a  short  ge¬ 
ometry  helps  simulate  far-range  solutions  quickly,  while  each 
excited  mode  in  (40)  is  assured  to  experience  lot  of  reflections 
from  both  boundaries  before  arriving  at  the  observation  range. 
The  standard  deviation  of  the  excitation  in  (40)  is  set  as  crx  = 
1A,  which  results  in  half  power  points  of  approximately  ±7.5° 
around  the  paraxial  axis  [13]. 

Fig.  9  depicts  solutions  at  the  given  range.  The  exact  DTBC 
solution  (dashed)  and  the  PML  solution  (pentagrams)  are  ob¬ 
viously  very  accurate,  they  match  the  analytical  solution  (solid 
curve)  at  every  altitude  of  the  model  geometry.  The  two  approx¬ 
imations,  i.e.  inaccurate  LDTBC  solutions  are  selected  on  pur¬ 
pose,  just  to  demonstrate  that  LDTBC  approximation  is  indeed 
severe  and  useless  if  Q  =  0.  In  that  case  it  is  just  truncation  of 
the  boundary  layer  convolution  in  Fig.  3  by  P  nodes.  We  choose 
an  L2 -norm  to  quantify  magnitude  of  errors 

j^so/n  _  ^ana/j^ 


Ei^rf 

3 


(43) 


where  at  discrete  altitude  j,  ^a.nal  is  the  analytical  field  solution 
and  'i/jj oln  is  the  numerical  field  solution  computed  (could  be  one 
of  PML,  DTBC,  LDTBC  or  LDTBC2).  This  error  is  depicted 
in  Fig.  10,  where  the  three  dashed  curves  show  the  L2-norm 
errors  for  LDTBC  approximations  with  different  Q.  The  hor¬ 
izontal  axis  is  P  varying  from  10  to  150,  and  the  three  errors 
expectedly  decay  with  increasing  P.  One  thing  to  recall  is  that 
LDTBC  is  not  necessarily  stable  for  a  given  P/Q  pair,  there¬ 
fore  while  generating  the  dashed  curves,  10  stable  P/Q  pairs  for 
each  Q  are  first  selected  based  on  the  3 -layer  model  discussed  in 
Section  II-D,  then  the  curves  are  formed  by  linear  interpolation 
of  errors  defined  in  (43).  These  errors  are  denoted  as  ef . 

Because  it  avoids  the  computational  burden  of  convolutions, 
LDTBC2  on  the  other  hand  offers  for  a  fast  and  accurate 
approximate  solution  as  depicted  in  Fig.  11.  The  LDTBC 2 
approximation  with  21  poles  (brown  squares)  for  given  dis¬ 
cretization  and  range  is  not  as  accurate;  on  the  other  hand  the 
approximation  with  101  poles  (pink  circles)  was  not  stable 
originally.  However,  inverting  the  poles  that  are  inside  the  unit 
circle,  LDTBC2  with  101  simple  poles  becomes  stable  and 
accurate  as  shown  in  Fig.  11.  It  avoids  the  stability  problem 
through  re-approximating  the  residues  of  re-located  poles  as 
outlined  in  Section  II-E,  and  accurately  mimics  the  analytical 
solution  while  being  efficient  in  CPU  time.  These  two  LDTBC 2 
solutions  produce  those  L2-norm  errors  shown  in  Fig.  10  with 
respective  color  curves,  denoted  as  e|.  These  curves  denote 
nothing  but  the  error  level  for  the  respective  approximations  in 
Fig.  11,  and  they  are  independent  of  P. 

The  quantity  ePML  in  Fig.  10  denotes  the  error  level  for 
the  PML  solution  (green  pentagrams)  which  was  also  depicted 
in  Fig.  9.  At  this  range,  PML  results  are  always  accurate  and 
robust.  Having  control  over  8,  T  and  hence  over  a0,  excellent 
absorption  could  be  achieved  with  PML  even  though  a  sig¬ 
nificant  spectrum  of  the  excitation  contains  low  grazing  angle 
waves.  Another  factor  in  favor  of  PML  over  DTBC  and  thus 
over  LDTBC  for  long  ranges  is  the  computational  effort,  where 
the  convolution  in  (23)  is  avoided  altogether.  To  achieve  the 
very  low  error  level  of  ePML  in  Fig.  10,  a  LDTBC  approxi¬ 
mation  of  order  P  =  150/Q  =  10  would  be  needed,  which  is 


1624 


104 

IEEE  TRANSACTIONS  ON  ANTENNAS  AND  PROPAGATION,  VOL.  59,  NO.  5,  MAY  2011 


£ 

x 


100 

90 

80 

70 

60 

50 

40 

30 

20 

10 

0 


10'3  10~2 

|y/A|  (V/m) 


*  £,=0.00759 » 

L _ I 


L^LI°!6i3! 


,  -  -  analytical  (xh=100  m,t=50  km) 
.  *- PML  (xh=  100  m,  t=50  km) 

.  e  -  LDTBC2(xh=100  m,  t=  50  km) 

- analytical  (xh=50  m,  t=20  km) 

-e—  LDTBC2  (xh=50  m,  t=  20  km) 
PML  (xh=  50  m,  t=20  km) 


00440 


=0,0211 


0 


Fig.  12.  Field  magnitudes  (V/m)  for  two  different  problems.  The  solid  curves 
are  solutions  at  t  —  20  km  range  for  a  xh  —  50  m  domain  and  dashed  lines 
at  t  —  50  km  range  for  xh  —  100  m.  The  simulation  parameters  are  Ax  = 
20  cm,  At  =  5  m,  xt  —  10  m,  ax  —  30  cm,  h  —  3  m,  L  —  150. 


neither  as  accurate  nor  as  fast  at  this  range  even  if  stable.  Thus 
it  is  clear  that  PML  and  LDTBC2  are  the  two  efficient  and 
accurate  numerical  solutions  for  domain  truncation  at  moderate 
ranges. 

Because  the  grazing  angle  content  becomes  very  narrow  for 
longer  ranges,  the  large  ratio  between  observation  range  and  do¬ 
main  height  can  render  the  PML  solution  inaccurate,  i.e.  PML 
would  fail  to  absorb  dominant  propagating  ray  [1].  The  next 
set  of  simulation  results  will  depict  such  a  more  realistic  case, 
where  the  domain  (in  free  space)  sizes  will  be  in  metric  units 
and  larger  along  both  altitude  and  range.  The  Gaussian  source 
will  reside  at  xt  =  10  m  and  the  operating  frequency  will  be 
/  =  1  GHz.  Two  different  cases  are  depicted  in  Fig.  12.  The 
dashed  curves  are  solutions  at  50  km  range  for  a  100  m  do¬ 
main  truncation  and  the  solid  curves  are  solutions  at  20  km  range 
for  50  m  domain  truncation  and  both  are  cases  of  far-range  and 
high-domain  simulations  for  which  the  LDTBC  approximation 
seemed  to  fail.  For  this  reason  only  PML  and  LDTBC2  are  sub¬ 
ject  to  comparison  with  respective  L2-norm  errors  as  marked  in 
the  figure.  Although  both  are  perfectly  absorbing  at  moderate 
and  small  ranges,  LDTBC2  generally  produces  a  smaller  error 
than  PML  does  at  far  ranges.  This  is  mainly  due  to  the  fact  that 
PML  cannot  be  pushed  further,  i.e.  using  a  thicker  matching 
layer  or  setting  an  extremely  small  reference  reflection  T  does 
not  help  beyond  a  certain  limit.  Indeed,  the  PML  parameters 
used  in  Fig.  12  are  the  limits  for  this  case  which  do  not  improve 
further.  The  parameter  L  on  the  other  hand  determines  the  order 
and  the  accuracy  of  LDTBC2,  thus  could  be  set  to  reasonably 
large  values  to  simulate  accurate  absorption.  However,  there  is 
also  a  limit  to  L,  thus  there  is  a  range-to-height  ratio  limit  to 
accurate  absorbing  LDTBC2  solutions.  This  limit  will  be  dis¬ 
cussed  later. 

Fig.  13  in  this  regard  analyzes  the  effect  of  observation  range 
and  domain  height  with  respect  to  the  error.  The  range  that  PML 
or  LDTBC2  with  fixed  parameters  start  to  fail  at  is  closer  when 
Xh  —  50  m  than  when  Xh  —  100  m.  This  is  obvious  since 
each  undesired  boundary  reflection  adds  inaccuracy  to  the  so¬ 
lution,  making  smaller  altitude  boundary  problems  harder  to 


Fig.  13.  L2-norm  errors  e2.  All  parameters  are  the  same  as  in  Fig.  12. 


simulate  at  far  ranges.  The  error  comparison  is  held  up  to  a 
range  where  the  T^-norm  errors  become  comparable  to  1  (which 
is  huge  in  this  case).  The  LDTBC2  error,  i.e.  e|  in  Fig.  13 
is  always  smaller  than  its  PML  counterpart  e2PML.  Therefore 
LDTBC2  with  151  simple  poles  for  our  case  is  clearly  more 
accurate  than  any  PML  solution  at  far  ranges.  Is  it  possible  then 
to  improve  it  further  by  setting  a  bigger  LI  As  indicated  be¬ 
fore,  there  also  is  a  certain  limit  to  how  big  L  would  be  chosen. 
Firstly,  solving  for  the  residues  bi  and  poles  hi  in  (38)  involves 
inverting  a  (L  +  1)  x  (L  +  1)  full-matrix.  Moreover  this  matrix 
to  be  inverted  contains  the  derivatives  of  the  transfer  function 
f(y\z  =  0),  y  =  M,  M+l, . . . ,  2 L+M.  Therefore  depending 
on  the  nature  of  the  transfer  function  f(z)  or  of  its  exact  Taylor 
coefficients  7,  this  matrix  could  turn  out  to  be  ill-conditioned. 
Practical  simulations  for  problems  of  our  interest  show  that  the 
condition  number  p  of  this  matrix  becomes  extremely  large  if 
L  >  200  and  MATLAB  cannot  handle  such  ill-conditioned  ma¬ 
trices.  That  is  why  our  choices  of  L  in  above  results  represents 
approximation  orders  close  to  the  practical  limit. 

Fig.  14  shows  the  CPU  time  for  DTBC  and  LDTBC2 
convolutions  with  increasing  range.  Computing  a  whole  new 
convolution  of  all  the  boundary  layer  values  at  each  march-in 
range,  exact  DTBC  solution  has  quadratic  dependency  on 
time  for  increasing  order,  whereas  recursive  computation  in 
LDTBC2  solution  is  linearly  dependent  on  range.  This  com¬ 
parison  between  DTBC  and  LDTBC2  depicted  in  Fig.  14  is 
only  for  the  boundary  computation,  i.e.  the  CPU  time  compar¬ 
ison  does  not  consider  time  for  matrix  inversion  and  update 
operations,  which  is  not  as  much  as  convolutions  times  at 
far  ranges.  Since  PML  is  totally  local,  i.e.  does  not  employ  a 
boundary  layer  convolution,  there  really  is  no  significant  added 
cost  to  implement  it  even  though  the  matching  layer  enlarges 
the  computation  domain  height  by  8.  Therefore,  we  can  surely 
say  that  PML  is  the  fastest  in  CPU  time  among  all  techniques 
discussed  here. 


IV.  Conclusions 

The  exact  DTBC  verified  is  unconditionally  stable  and 
presents  reflection-free  boundary  layer  for  open  PE  problems. 
However,  its  computational  deficiency  depicted  in  Fig.  3  and  in 
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Fig.  14.  CPU  time  taken  by  the  boundary  computation  (convolution  in  DTBC 
case). 


Fig.  14  motivates  localization  of  the  boundary  layer  convolu¬ 
tion.  Although  they  are  conditionally  stable  and  not  always  as 
accurate  as  DTBC,  LDTBC  and  LDTBC2  are  computationally 
more  efficient  thus  more  practical.  The  FD  and  narrow-angle 
PE  constraints  apply  for  both  exact  and  approximate  transfer 
functions,  therefore  the  approximations  would  be  preferable  at 
not  so  close  ranges,  because  they  reduce  the  convolution  time 
significantly.  LDTBC2  especially  reduces  computation  time 
dramatically  and  is  assured  to  be  stable  due  to  the  modifications 
to  residue/pole  locations  suggested  in  the  paper. 

PML  on  the  other  hand  is  robust,  fast  and  is  alternative  to 
LDTBC2  at  moderate  ranges.  We  were  able  to  verify  that  the 
degree  of  freedom  to  set  the  layer  thickness  and  layer  loss  in 
according  to  the  desired  maximum  reflection  T0  makes  it  easily 
verifiable  and  applicable  to  truncate  open  geometries  governed 
by  PE  using  Crank-Nicolson  scheme.  Fig.  10  summarizes  a 
comparison,  that  PML  and  LDTBC2  are  the  appropriate  trunca¬ 
tion  techniques  for  computations  at  moderate  ranges.  The  study 
of  these  techniques  at  typical  far  ranges  for  high  geometries  in 
Fig.  12  and  in  Fig.  13,  where  PML  fails,  is  interesting.  There, 
LDTBC2  remains  as  the  best  solution  among  all.  The  practical 
limit  to  L  makes  its  operation  range  also  limited.  We  do  not 
delve  to  numerically  improve  this  ill-condition,  and  avoiding 
this  restriction  would  help  simulate  PE  truncation  at  even  far¬ 
ther  ranges. 

The  procedure  detailed  here  for  the  derivation  of  approximate 
boundary  conditions  is  also  applicable  to  the  wide-angle  PE  as 
long  as  a  suitable  discretization  scheme  is  available  in  the  inte¬ 
rior  domain.  This  study  will  be  taken  up  in  the  future. 
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